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1.   INTRODUCTION 

During  the  past  decade,  there  has  been  a  remarkable  growth  of  interest 
in  problems  of  dynamic  optimization.   This  has  given  rise  to  a  number  of 
methods  useful  for  rendering  systems  optimum.   One  such  method  is  Pontryagin's 
maximum  principle.   Originally  it  was  developed,  in  1956,  for  continuous 
processes  and  has  been  chiefly  applied  in  the  field  of  optimum  system  con- 
trol [8J. 

The  first  attempt  to  extend  the  maximum  principle  to  the  optimization 
of  stagewise  processes  was  made  by  Rozoner  in  1959.   The  various  versions  of 
the  discrete  maximum  principle  were  proposed  by  Chang  [2],  Katz  [7j,  and 
Fan  and  Wang  [4],   Most  of  the  published  literature  on  the  application  of 
the  maximum  principle  is  in  the  field  of  control  and  process  design.   Exam- 
ples of  its  application  to  management  and  operations  research  problems, 
however,  are  still  limited. 

The  aim  of  this  report  is  to  demonstrate  the  applicability  of  the 
discrete  maximum  principle  to  one-dimensional  multi-stage  non-linear  as  well 
as  linear  processes  in  management:  and  industry.   Only  deterministic  processes 
are  considered  here. 

A  multi-stage  decision  process  may  be  considered  as  an  abstract  notion 
by  which  a'  large  number  of  human  activities  can  be  represented.   A  stage  may 
represent  any  real  or  abstract  entity  (a  space  unit,  a  time  period  or  an 
economic  activity)  in  which  a  transformation  takes  place.   Those  variables 
which  are  transformed  in  each  stage  are  called  state  variables.   The  desired 
transformation  for  the  state  variables  is  achieved  through  manipulation  of 
decision  variables  which  remain,  or  may  be  considered  to  remain,  constant 
vithin  each  stage  of  the  process.   The  equations  which  completely  describe 


the  transformation  at  each  stage  are  called  performance  equations.  A 
homogeneous  process  is  one  in  which  the  state  variables  and  the  decision 
variables  are  inter-related  by  the  same  set  of  performance  equations.  A 
process  is  called  heterogeneous  if  it  is  not  a  homogeneous  process.  A  pro- 
cess with  a  single  state  variable  is  called  a  one-dimensional  process.   Any 
process  whose  performance  equations  are  linear  in  state  variables  is  called 
a  linear  process.  A  process  which  is  not  linear  is  called  a  non-linear  pro- 
cess. 

The  basic  algorithm  of  the  discrete  maximum  principle  is  first  stated. 
The  general  form  of  performance  equations,  both  for  non-linear  and  linear 
one-dimensional  processes,  is  then  given.   The  recurrence  relation  of  the 
optimal  state  and  decision  for  non-linear  as  well  as  linear  processes  are 
next  presented.   Examples  (1)  through  (5)  are  the  case  studies  of  non-linear 
processes.   Examples  (5a)  through  (7)  are  the  case  studies  of  linear  processes. 

In  each  of  the  examples  considered,  the  discrete  maximum  principle  has 
lead  to  the  optiraality  condition  represented  by  a  recurrence  relation  of  the 
control  variable.   Such  a  recurrence  relation  is  generally  valid  for  an  n- 
stage  system.   For  each  of  the  special  cases  treated,  a  general  solution  is 
reduced  immediately  to  a  specific  solution  which  agrees  with  the  available 
results  obtained  by  means  of  the  Lagrange  multiplier  technique  and  by 
dynamic  programming. 

At  the  end  optimum  recurrence  equations  for  multi -dimensional  processes 
are  presented. 


2.   THE  DISCRETE  MAXIMUM  PRINCIPLE 

STATEMENT  OF  THE  ALGORITHM 

The  following  is  an  outline  of  the  general  algorithm  of  the  discrete 
maximum  principle  [4j. 

A  multistage  decision  process  consisting  of  N  stages  in  sequence  is 
schematically  shown  in  Fig.  1.   The  state  of  the  process  stream  denoted  by  an 
j-dimensional  vector,  x  ■  (x.,  x  ,...,  x  ),  is  transformed  at  each  stage 
according  to  an  r-dimensional  decision  vector,  9  =(8.,  9  ,...,  9  ),  which 
represents  the  decision  made  at  that  stage.   The  transformation  of  the  pro- 
cess stream  at  the  n   stage  is  described  by  a  set  of  performance  equations 

n  _  Tn  .  n-1   n-1       n-lt   n  _n      _n. 
x.  -  i.  ^x.   ,  x_   ,...»  x   ;  v.,   w  ,...,  «*_/» 

x  =  °<    ,         i  =  1,  2,...,  s;    n  =  1,  2,...,  N. 

or  in  vector  form 

x"  =  Tn  (x""1;  9n),         n  =  1,  2 N,  (1) 


0 


=  <* 


A  typical  optimization  problem  associated  with  such  a  process  is  to  find  a 
sequence  of  9  ,  n  ■  1,  2,...,  N,  subject  to  constraints 

0?  [•£,  9^ 0j]<0,  (2) 

n  =  1,  2, . . . ,  N, 
i  =  1,  2,...,  r, 

which  makes  a  function  of  the  state  variable  of  the  final  stage  N 
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S  a  2  ex.,     c  =  constant,  (3) 

en  extremum  when  the  initial  condition  x  ■  °<  is  given.  The  function  S 
which  is  to  be  maximized  (or  minimized)  is  the  objective  function  of  the 
process. 

The  procedure  for  solving  such  an  optimization  problem  by  the  discrete 
maximum  principle  is  to  introduce  an  s-dimensional  adjoint  vector  z  and  a 
Harailtonian  function  H°  satisfying  the  following  relations 

Hn  =  (zn)Txn  =  Z     z"  Tj  (xn_1;  0n),      n  =  1,  2 N,         (4) 

i=l 


J"1  =  -~Tf,     i  =  1,  2,...,  s;   n  -  1,  2,...,  N,  (5) 


i 
and 

z?  ■  c,,  i  ■  1,  2,...,  s.  (6) 

i    i 

If  the  optimal  decision  vector  function  9  ,  which  makes  the  objective 
function  S  an  extremum  (maximum  or  minimum),  is  interior  to  the  set  of 
admissible  decisions  0°,  the  set  given  by  equation  (2),  a  necessary  condition 
for  S  to  be  a  (local)  extremum  with  respect  to  9  is 

-&E-  =0,  n  ■  1,  2 N.  (7) 

B9n 

If  9°  is  at  a  boundary  of  the  set,  it  can  be  determined  from  the  condition 
that  Hn  is  (locally)  extremum.   The  following  special  cases  can  be  considered 

[6]: 

(i)  A  necessary  condition  for  S  to  be  a  (local)  extremum  with  respect  to  9  , 


is 

71  Hn 
-SJL-     »  0  ,  n  =  1,  2,...,  N  . 

(ii)   When  the  performance  equation  is  linear  in  state  variables  x   , 
namely 

T"(xn_1;  6n)  =  E  k*A9n)xn-1   +  f"(0n)  ,  (8) 

i-l  **     J      * 

a  local  maximum  (or  minimum)  of  the  objective  function  corresponds  to 
local  maximum  (or  minimum)  of  the  Hamiltonian  function.   In  other 
words, 

H   ■  maximum  (or  minimum) 

is  the  necessary  condition  for  the  objective  function  to  be  locally 
maximum  (or  minimum). 

(iii)  When  A.,  in  equation  (8)  is  constant,  or  when  the  optimal  decision  is 
always  known  to  be  on  the  boundary  of  its  admissible  decision,  the 
objective  function  is  absolutely  maximum  (or  minimum)  if  and  only  if 
H  is  absolutely  maximum  (or  minimum). 

(iv)  When  the  performance  equation  is  linear  in  their  arguments,  that  is, 

i        s        i    r 
T"(xn"1;  9n)  =  2  An  vn_l  ♦  2  b"  9?  ,  (8a) 


then, 


H   =  maximum  (or  minimum), 


is  necessary  as  well  as  sufficient  for  the  objective  function,  S,  to 


be  absolutely  (or  globaly)  maximum  (or  minimum). 

For  the  optimization  problems  in  which  some  of  the  final  values  of  state 

N  N        N 

variables,  x. ,  are  pre-assigned,  such  as  x  ■  c.,  x^  =  c^,   and  the  objective 

function  is  specified  as 

o  .  i  N 

S  ■  2  c.  x.  , 

i=l  X   X 

i?a 

i?b 

the  basic  algorithm  represented  by  equations  (4)  through  (7)  is  still 
applicable,  except  that  equation  (6)  is  replaced  by 

z^  =  ci,  i  =  1,  2,...,  s.  (9) 

1  f   a,  bt 

THE  PERFORMANCE  EQUATIONS  OF  ONE-DIMENSIONAL  PROCESSES  [4] 

If  a  multistage  decision  process  can  be  completely  characterized  for 

the  purpose  of  optimization  by  a  single  state  variable,  the  process  is 

called  a  one-dimensional  multistage  decision  process. 

For  a  one-dimensional  process,  there  is  only  one  state  variable  x. 

satisfying  the  performance  equation 

x"  =  T  (x""1;  e"),        n  =  1,  2,...,  N  (10) 

•      1       1 

where  T  is  the  transformation  operator  and  9  is  the  decision  variable.   In 
general,  the  objective  function  to  be  maximized  is  the  sum  of  a  certain 
function  of  x  and  9  over  all  stages  of  the  system  such  as 

Z  G  (K?"li  ©n). 
n=l 


The  optimization  problem  associated  with  such  a  process  is  to  find  a  sequence 
of  decision  variables  8  ,  n  =  1,  2,...,  N  so  as  to  maximize 

2  G  (x""1;  9n) 
n=l 

with  x.  given.   Introducing  a  new  state  variable  x~  satisfying 


n  -    n~l  J.  o   /   n"l    nn\  0  -  r. 

X2    2         1   *     »     X2     ' 


n  =  1,  2,... ,  N, 


(11) 


such  that 

N 

^  n   ,   n-1   _n.     N 

2-  G  (xx   ;  9  )  =  x2  . 

n=l 

Thus  the  problem  is  transformed  into  the  standard  form  in  which  a 

n  N 

sequence  of  0  ,  n  =  1,  2,...,  N,  is  to  be  chosen  so  as  to  maximize  x„  for 

a  process  described  by  equations  (10)  and  (11).  x.  is  called  the  primary 

state  variable  and  x„  the  secondary  state  variable. 

A  number  of  one-dimensional  processes  with  single  state  variables  has 

the  following  form  of  performance  equations. 

xj=  xj"1  *«  fl    (0°)  ,       x°  =  0  ,  (12) 

x^  =  x^1  ♦  (3  U[  -   xj"1)  ♦  F2  (9n)  ,     x°  =  0  .      (13) 

Here  F  (9  )  and  F  (9  )  are  two  arbitrary  functions  of  the  decision  variable 
9  ;  c<  and  ^>  are  arbitrary  constants. 

A  comparison  of  equations  (12)  and  (13)  with  equations  (10)  and  (11) 
immediately  shows  that 


T  (xn_1;  9")  =  x""1  W[Fl  (9°)]  , 
G  (xn"L;  9n)  =-<^[F1  (9°)]  ♦  F2  (Gn) 


Performance  equations  (12)  and  (13)  are  linear  in  state  variables. 
Hence  the  processes  represented  by  these  equations  are  referred  to  as  one- 
dimensional  multistage  linear  processes.  Any  process  whose  performance 
equations  are  not  linear  in  state  variables  is  called  a  non-linear  process. 

THE  RECURRENCE  RELATION  OF  THE  OPTIMAL  STATE  AND  DECISION  FOR  THE  NONLINEAR 
PROCESSES  [A] 

Let  the  nonlinear  process  be  represented  by  performance  equations  (10) 
and  (11)  with  the  objective  function 

S=x!J.  U*) 

Then  the  Hamiltonian  function  H  given  by  equation  (4)  can  be  written  as 

H°  =  zn  T  (x""1;  9n)  ♦  zn  [x^1  ♦  G  (x""1;  9°)]  .       (15) 

According  to  equation  (5),  the  recurrence  relations  for  the  adjoint  vector 
elements  z.  and  z„  are  found  to  be 

n  1    3Hn    3T<*l"li  e">   n   9G  UT' >    ^   n 
zn-l  m   _3H__  =  L- . zn  +  L_^ zn  (16) 

1     .  n-1      _  n-1      1         n-1      2 
^x       3x.  ax1 

zo     — TT       z9  »  n-1,  2,...,  N  .  (17) 

2     _  n-1    l 
ox2 

-,  N    N 

Since  the  objective  function  is  S  3  2.  c.  x.  =  x  ,  that  is,  c  ■  0,  c  =  1, 

i=l  X     X 
Chen,  we  obtain 
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zj  =  0  ,  (18a) 

«J  -  I  .  (18b) 

Combining  equation  (18b)  and  (17)  and  substituting  in  equation  (16)  gives 

z£  -   1  ,        n  =  1,  2,...,  N  ,  (19) 

and 

_  ,  n-1   «n.      _  _  ,  n-1  _n. 
3T  (x   ;  0  )     3G  (x   ;  0  ) 

n-1  =  L_ "  +  i__ (20) 

1  n-1  1      _  n-1 

3  xL  3Xj 

n  =  1,  2,...,  N  . 

Combining  equations  (19)  and  (15),  we  obtain 

»,n      n  _  ,  n-1  „n.  .  _  .  n-1  ^n.    n-1 
H   =  zx   T  (x.   ;  0  )  +  G  (x.   ;  0  )  +  x2   , 

n  =  1,  2,...,  N  . 

According  to  equation  (7),  9  may  be  found  where 

_  ,  n-1  _n.    _  ,  n-1  „n. 
^Hn     JT  (X.   ;  9  )   ^G  (xx   ;  9  ) 

■  z  +  .  ■  o  . 

Solving  this  equation  for  z. ,   we  obtain 


•oG  (xn_1;   0n) 

n 

S9n 

»1  "   ' 

"oT   (xj"1;   9n) 

(21) 


39 

Substitution  of  equation  (21)  into  equation  (20)  gives  the  recurrence 
relation 


11 

3G  (x?"lJ  Gn)     dG   (x"  ;  Gn+1) 

■                                ii                      i^       l-i+l               n       n+1 

_n            a  n+1        3T  (x"  ;  Gn+1)   3G  (x   ;  e"  ^ 

oq                               dG         .1              1          (~~) 

ST  Cx?"1;  Gn)     2T  (x°  ;  Gn+1)        5  xj            3  xj 

a6"            d°n+l                                           n-1.  2      N-1. 

Combining  equations  (18a)  and  (21)  gives 

1          -   n                                         (ill 

0.                                    (23) 
5G 

Making  use  of  recurrence  relation  (22)  along  with  performance  equation 

(10)  and  relation  (23),  a  number  of  optimization  problems  associated  with  one 

dimensional  processes  can  be  solved. 

N                N 
For  processes  with  fixed  end  point  x.,  the  condition  z.=  0  (equation 

18a)  or  equivalent  relation  (23)  is  deleted. 

GENERAL  SOLUTION  OF  LINEAR  PROCESSES 

Comparing  performance  equations  (12)  and  (13)  of  a  linear  process  with 

equations  (10)  and  (11)  respectively,  it  follows 

T  (xJ'S  9°)  =  x""1  +  cX  F1(9n)                         (24) 

G  (xj"l|  G")  =  P>(xJ  -  xj"1)  +  F2(Gn) 

=  <*  f>    F  (0n)  +  F2(Gn),    n  =  1,  2,...,  N.(25) 

The  partial  derivatives  of  equations  (24)  and  (25)  with  respect  to  x    and 

9  yields 

3T  (x""1;  6n)     3F  (Gn) 

3Gn          dQn 

3T  (x?"1;  Gn) 

''   ,         1»                                 (27) 
_  n-1 

5x1 

12 


dG   (x""1;  e")       SF.(Gn)    9Fo(0n) 

1 =c<p   _i +  _J (28) 

dG   (X?"1;  9n) 

i__ .  0>  (29) 

i  n-1 

Substituting  equations  (26)  through  (29)  into  equation  (22),  we  obtain 


9F,(9n)     2F0(9n)      ,  BFA9n)  3FAQn+l)     3F0(9n+1)      /  ».  (9n+1) 


■    ^     39°  29°       /       39°  39n+1  39n+1       /       29n+1 


-(30) 


or 


3F2(9n)  /^F1(9n)     3F2(9n+1)  /ZFAQn+1) 
39°   /   39°    =    39n   /   3  9n+1 

from  which  we  conclude  that 

9°  =  9n+1,        n  =  1,  2 N-1.  (31) 

Hence  the  optimal  policy  for  the  class  of  linear  processes  described  by 
equations  (12)  and  (13)  requires  using  the  same  value  of  the  decision  variable 
for  all  stages. 

A  number  of  one-dimensional  processes  may  also  be  represented  by  the 

following  form  of  the  performance  equations  [4], 

« 

xi =  xi-1  Fi(0n)  +0(  £pi<*n)  -  d.      *l =  °»  (32) 

x^  =  x^"1  +  p  (xj  -  x^1)  ♦  F2(9n),    x°  =  0.         (33) 

It  is  seen  [4j  that  the  optimal  policies  for  such  a  class  of  processes  is  to 
apply  an  equal  value  of  the  decision  variable  at  each  stage  as  given  by 
equation  (31). 
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3.   CASE  STUDIES  OF  NON-LINEAR  PROCESSES 

The  use  of  the  recurrence  equations  of  the  optimal  state  and  decision 
is  demonstrated  by  solving  some  management  problems  with  non-linear  cost 
functions. 

The  problems  are  first  stated  as  two  stage  processes;  however,  the 
general  solutions  obtained  by  the  maximum  principle  are  for  multi -stages 
(H  >  2).   Then,  the  solution  for  the  two  stage  processes  is  considered  as 
a  special  case  of  general  solution. 

EXAMPLE  (1).  A  PRODUCTION  SCHEDULING  PLAN 

PROBLEM  [5]: 

A  company  must  produce  a  total  quantity  s  in  N-month  periods.   Let  n  be 
the  index  for  months  and  p  be  the  quantity  that  will  be  produced  in  the  n 
month  of  N-month  long  production  period.   There  are  many  production  plans 
that  meet  the  requirements 

N 

2  p  =  s  ;  •   p  ^  0.  (1) 

n=l 

Therefore  to  make  the  problem  definite,  a  non-negative  weighting  factor  w  is 
assigned  to  the  production  in  the  n   month,  and  it  is  required  then  to 
determine  a  production  plan  which  minimizes  the  sum  of  weighted  squares  of 
production  over  the  N-raonth  period.   The  effect  of  the  weighting  factor  would 
be  to  allow  management  to  penalize  production  in  some  months  more  than  others, 
Thus  the  problem  is  to  minimize 

N 
Min   2  w°(pn)  (2) 

n  n=l 
P 
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subject  to  constraints  in  equation  (1). 


SOLUTION  BY  THE  MAXIMUM  PRINCIPLE 

Let  each  month  represent  one  stage,  and  let  us  define 
0  ■  p  =  production  during  n   month  of  N-month  period, 

x  ■  quantity  that  remains  to  be  produced  in  (N-n)  months, 

th 
x  =  sum  of  weighted  squares  of  production  up  to  and  including  n 

month. 

The  N-stage  process  can  then  be  represented  by  the  following  performance 

equations: 

x  =  x.   -  9  ,     x.  =  s,     x.  -  0,  (3) 

n  -  1,  2,...,  N, 

x£  =  x^1  ♦  wn(9n)2,     x°  =  0.  (4) 

Constraints:  0  >  0,       n  ■  1,  2 N. 

Objective  function: 

w,  j  ,      v,   n.„n.2    N 
Minimize  ^     w  (0  )  =  x„. 

n=l 

The  solution  is  obtained  by  comparing  equations  (3)  and  (4)  with  equations 
(10)  and  (11)  of  Sec.  2  of  one-dimensional  process,  and  we  obtain 

T  (xJ'S  0°)  =  xj"1  -  0°, 

G  (xj"1;  0n)  =  wn(0n)2. 

Differentiating  these  functions  with  respect  to  x    and  0  gives 
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■JT  (xj-1;   0n) 

7? 


ST  (xj_1;   e") 
3  x 


=     -1,  (5) 


1,  (6) 


2G   (x""1;    e") 

1  ~      n^n 


^G" 


-  ~    ,   n-1      _n. 
3G  (Xj      ;   6   ) 

3x. 


■      2  wV\  (7) 


0.  (8) 


Substituting  equations  (5)  through  (8)  into  recurrence  equation  (22)  Sec.  2 
yields 

.  n  n        n+l_n+l 
2  w  6   _   2  w   9 

-1  -1    "°» 

or 

.,   n+1 

G"  =  Gn+1  *—  .  (9) 

n 
w 

Equation  (9)  is  the  recurrence  relation  of  the  optimal  decision. 

N        N 
With  x.  given,  G  can  be  computed  from  equation  (3)  by  assuming  a  value 

of  x   .   The  corresponding  value  of  x  is  obtained  from  equations  (3)  and 

(9)  and  is  then  directly  compared  with  the  given  value  of  x.  .   The  trial 

calculations  are  repeated  until  the  computed  value  is  sufficiently  close  to 

the  given  one.   The  sequence  of  computed  6  ,  n  =  1,  2 N  for  each  assumed 

N-1 
value  of  x    is  the  optimal  sequence  corresponding  to  the  initial  condition 

x.  obtained  in  each  run  of  trial  calculations. 

To  find  the  optimal  sequence  of  6°,  n  =  1,  2,...,  N  for  x°  ■  s  we 


proceed  as  follows; 


N-l 


Let  c  =  assumed  value  of  x  ~  .  For  n  ■  N  equation  (3)  becomes 


N  _   N-l  aN 
Xl   Xl  "9 


N  N-l 

Since  x.  "  0  and  x    ■  c,  we  obtain 


0  =  c. 


Substituting  equation  (10)  into  equation  (9)  for  n  =  N-l  yields 


eN-l  .  QN  jJL 
9      6   N-l 
w 
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(10) 


-  c 


N-l  * 


w 


(11) 


For  n  =  N-l  equation  (3)  becomes 


N-l  _   N-2   .N-l 
Xl   ~  Xl    "  9 


(12) 


Substituting  equation  (11)  into  equation  (12)  yields 

N-l        N-2      wN 
x    -  c  -  x.    -  c 


w 


N-l  ' 


or 


N-2 


C  *  C 


N-l 


(13) 


Again  from  equation  (9)  and  equation  (3)  for  n  =  N-2,  we  obtain 

N-l 


rtN-2   „N-1  w 
0    =0 


N-2  ' 


or 


MO                    N  N"1 

N-2  _  w        .    w 

6               C      N-l  N-2 

w  w 
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N 


N-2    ' 


(14) 


and 


or 


Similarly 


N-2  N-3        „N-2 

Xl        =  Xl        "  9 


N-3  _      N-2    .    QN-2 
xl        "  xl        +  6 


N  N 

w  w 

=      r-      T      c  ■    -  +      C     ~  ~  ~  ~ 

N-l  N-2 

w  w 


...  N  N  N 

N-4  w  v?  w 

v  =    c    +    c   +    c   — — — —  +    c   — --•*■     . 

Xl  C        C      N-l        C      N-2  N-3    * 

www 


N  N  N 

1        _  w  w  w 

X  =    c   +   c   +   c   +    .  .    •    c   —    . 

XI  C  N-l  N-2         '  2    * 

WW  w 


N  N  N 

0       _  w  w  w 

Xl  C  *C"fo  +  C~^+   '••  +  C"T  ■ 

WW  w 


or 


o      -      r  i        w 

xi    - c  [1  +  irr+  • 


N 
w 


w    L —  5 


N  N-l 

w         w 


1   J 


-  c 


wN     [  2       M   . 


n=l     w 
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Since  x.  ■  s  [from  equation  (3) J, 

u    N   1 

N  r  v      l-i 
s  -  c  w  L  *  ~J  , 

n=l  w 

cr 

- 

c  = 

s 

i-  =   0N 
w 

N  1 

-i   n 
n=l  w  . 

or  generalizing 

- 

"  ' 

Gn  = 

s 

1_ 

• 
n 
w 

(15) 

N  1 
2  — 

-i  n 
n=l  w 

A  Numerical  Example: 

Let 

s  ■  9 

N  =  3 

I  _  «      2_.      3  _  „ 

w  -  o,    w  -  3,    w  -  2, 

then 

n=lwn   6   3   2    ' 

•   '    eL  = 

s 

n    I   6   ^^ 
w    w 

5  J- 

-1  n 

n=l  w  , 

w           w 

w 

19 


SOLUTION  BY  THE  LAGRANGE  MULTIPLIER  METHOD 

The  following  is  the  solution  to  the  same  problem  using  the  Lagrange 
multiplier  method. 


To  minimize 

N 


2  wn(pn)2,     (pn  ■  9n>,    ,  (16) 

n=l 

subject  to  constraint 

N 

2  pn=  s,  C17) 

n=l 

the  following  quantity  is  first  formed  from  equation  (16)  and  (17). 

N  O  N     n 

2  w"(pn)2  +  >^  (  2  pn  -  s)  (18) 

n=l  n=l 

where  >\  is  an  undetermined  coefficient  (multiplier).   Differentiating  it 
with  respect  to  p  and  equating  to  zero  yields 

2wnpn+*  =  0,  (19) 

or 


n   -  h 
2  w 


(20) 


Substituting  equation  (20)  into  equation  (17),  we  obtain 


or 


5  -> 

n=l  2  w 


n=l  w 
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or 


-2  s 


A=~-§-.  (21) 


z   A- 
-i  n 

n-l  w 


Combination  of  equations  (20)  and  (21)  yields 

1 


n 
P 


-i   n 

n-l  w  _ 


—  ,        n  =  1,  2,...,  N  (22) 

n  ' 
w 


which  is  equivalent  to  equation  (15),  the  same  result  as  obtained  by  maximum 
principle.   However  the  constraint  p  ^.  0  may  not  always  be  satisfied  by  this 
approach  and  this  method  does  not  guarantee  that  all  p  ' s,  n  =  1,  2,...,   N, 
shall  be  positive.   The  requirement  that  all  production  quantities  must  be 
positive  is  difficult  to  incorporate  in  the  Lagrange  multiplier  method.   The 
maximum  principle  approach  and  dynamic  programming  approach  can  handle  this 
type  of  difficulty. 

SOLUTION  BY  DYNAMIC  PROGRAMMING  [5] 
Let 

p(mln)  =  amount  to  be  produced  in  the  n   month  from  the  end  if  a 

quantity  m  remains  to  be  made  in  n  monthly  periods. 
'v(mln)  =  the  minimum  weighted  sum  of  squares  obtainable  if  the 
total  amount  to  be  made  is  m  and  n  periods  remain. 
Then  according  to  Bellman's  principle  of  optimality,  the  optimal  policy  to 
minimize  cost  function  (weighted  squares  of  production)  should  minimize 
weighted  square  of  production  w  (p  )  for  the  current  month  and  total  weighed 
squares  of  production  v(m-p  jn-1)  for  the  remainder  of  (n-l)  months  (subse- 
quent stages  resulting  from  this  decision). 
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Also  production  should  be  positive.   Then 

v(m 

Min     „n.  nN2  .  .        n 
n)  =            2  (p  )   +  v(m-p 

n-1) 

(23) 

o  <:  p"  <:  ■ 

m^-0,        n  =  2 ,  3 ,  •  .  . 

Consider  the  situation  when  there  is  only  one  month  remaining  in  which 

to 

make  total  quantity  m  .  There  is  not  then  much  choice  but  to  produce  i 

1  . 
n  in 

112 
this  month  and  the  total  sum  of  the  squares  will  be  w  (m  )  ,  giving 

1  -  ,    M  i  %  -  l 
p  -  p(m  1)  -  m 

1   1 

"Tra 

.  w 

(24) 

1 

"T 

w 

.  ll  .  ,  _   1,  1.2 
v(m  1)  =  w  (m  ) 

1    ' 

1 
w 

(25) 

With  two  months  remaining  and  the  total  quantity  which  remains  to 

be 

2 
produced  being  m  ,  we  have  from  equation  (23) 

v(m2|2)  =             [w2(p2)2  +  v(m2-p2|l)]  , 

0  ^  P  <cr  m 

but 

2  21        1 
.     v(m  -p  1)  =  v(ra 

,\  _   1,  1,2  _   12  2,2 
1)  -  w  (m  )  -  w  (ra  -p  )   . 

Since 

1  _  2  2 
m  -  m  -p 

hence 

21    _     Min      r  2.  2,2  ,   1,  2  2,2i 
v(ra  2)  -             [w  (p  )   +  w  (m  -p  )  J  . 

(26) 

1     0^  p  ^  m 
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2 

Differentiating  equation  (26)  partially  with  respect  to  p  and  equating  to 


sero,  we  obtain 


.22   _   1.  2  2,  _  n 
2  w  p  -  2  w  (m  -p  )  =  0, 


or 


1 

2 

1    2 

2 

m 

w  m 

w 

p  -  p(m  2) j J—  .  U7) 

(w  +  wZ)   ~  ♦  •— 
w    w 


Substituting  equation  (27)  into  equation  (26)  gives 


0  12   2    .    .     12    2 
.  2  .,     2   w  a         1    2    w  m 

v(m  2)  -  w   — r r   +  w   m  -  — r ^ 

w  +  w  w  +  w 

2,  1,2,  2,2    1,  2,2,  2,2 

-  w  (w  )  (m  )   .  w  (w  )  (m  ) 

,  1  .   2,2     ,  1    2,2 
(w  +  w  )      (w  +  w  ) 

* 

1  2,  2,2    ,  2,2 

-  w  w  (m  )      (m  ) 

,  1  .   2,  "  1   ,1   * 
(w  +  w  )    j»    1 

w    w 

3 
?or  n-3,  that  is,  three  months  remain  and  a  quantity  m  remains  to  be 

produced 

3         2    3    3       3 
m  -  s  and  m  -m  -p  -s-p, 


(28) 


aence 


v(m3|3)  =  v(s|3)  -     m\n         [w3(p3)2  +  v(s-p3  2)]  . 

o^r  p  <$  s 


Substituting  equation  (28)  into  above  equation  yields 

1  2 


,    L,  _  3,  3,2  ,   w  w      .     3.2  ,_-. 

v(s|3)  =  w  (p  )  +  — J ~  (s  -  p  )   .  (29) 

(w  +  w  ) 
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3 
Differentiating  equation  (29)  with  respect  to  p  and  equating  to  zero  yields 

1  2 
i  3  3   _   w  w      .  3,  _  n 

2  w  p  -  2  — r-  (s  -  p  )  -  0, 

(w  +  w  ) 
or 

3,  12,   13,   2  3,.   12 
p(ww  +  w  w  +ww)-wwst 

or 


-  1  2 

3  _  ww  s 

12.   13,   23* 

WW  +ww   +ww 


Dividing  equation  (30)  by  ■-. -•  ■  -  yields 

www 


3  _ 


1 
TS 


^  =  Z7I-7I 


3  2  1 

www 


Substituting  equation  (30)  into  equation  (29),  we  obtain 


1   2 
,    tos  .  r   3,   3.2  ,      w  w  .  3.2-1 

v(s|3)  =  Lw  (p   )     +  ~ r     (s   -  p   )   J 

w     +  w 


1   2  3,    ,2 

www   (s) 


,12,      13,      23, 
(ww     +ww     +ww) 


(s)2 


1_+  l_  +  i_  * 

3  2  1 

www 


(30) 


P-  =  P(s  3)  =  7-*-: -  .  (31) 


(32) 


It  can  be  shown  from  equations  (24),  (27)  and  (31),  by  induction,  that 
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p(mB|B)  = 


B 

m 

B  .    ~B  » 
2  i-  I  w 

n-1  w 


B=  L|  2,  3  ... 


(33) 


where  B  are  the  months  remaining  and  m  is  the  quantity  remaining  to  be 
produced  in  B  periods.   Also  from  equations  (25),  (28)  and  (32),  we  obtain 

B.2 


v(m  |B)  =   j  '    , 


B   1 ,  2, .  •  • 


(34) 


2  i- 

n-1  w 


For  the  given  numerical  example,  the  solution  is  as  follows.   From  equation 
(32),  we  obtain 


v(s 


3)  =  v(9  3)  = 


1*1  +  1 

2   3   6 


(81)  =  81  . 


From  equation  (31) 


3  -   ,QL,  ..    1/6 
p  -  p(9  3)  -  - 


1  +  1  +  1 

2  3   6 


(9)  =   1.5  , 


2       3 
m  =  s  -  p  =9-  1.5  ■  7.5  . 


From  equations  (27)  and  (28)  respectively  we  obtain 

2 


P  =  p(7.5 


2)  = 


1/w 


-   1/3 


•i— r-  '  (7.5)  =  7i~-  (7.5)  =  3  , 

+  —  ■=■  +  ■=• 

2   3 


l_ 

1    2 
w    w 


and 


v(7.5 


o-v  -  (7.5) 


w    w 


-   56.25  _ 


2   3 


=  67.5  , 


12    2 
m  =  m  -  p  =  7.5  -  3  =  4.5  . 
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From  equation  (25)  then 


p(4.5|  1)  =  4.5, 


v(4.5|l)  =  -~^"  =  2(20.25)  =  40.5. 


These  results  agree  with  those  obtained  by  the  maximum  principle.   Equations 
(15)  and  (33)  respectively,  i.e., 


en  = 


l 


N  l 

-i  n 
_n-l  w 


n  =  1,  2,...,  N, 


r  »  '  i    B 

pLm  BJ  -  p  = 


1  i- 

-i   n 

n-1  w  . 


B  ' 


B—  1,  2, .  .  . 


however,  should  not  create  confusion.   In  the  first  equation  obtained  by  the 
maximum  principle,  s  is  the  total  quantity  to  be  produced  in  total  N-month 
periods,  9  being  the  production  in  n   month  from  beginning;  whereas  in  the 
second  equation,  m  is  the  quantity  remains  to  be  produced  in  remaining  B 
months,  and  p  is  the  production  in  the  B   month  from  the  end. 


EXAMPLE  (2).  AN  ALLOCATION  PROBLEM 

PROBLEM  [Ref.  1,  p.  252]: 

A  firm  has  two  production  facilities  producing  one  product.   The  total 
production  costs  of  each  facility  are  related  to  the  output  levels  as 
follows 


TCl(yi)  =  &l  +   b^  +  Cjjj,     a1§  b1§  c2  >  0, 
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Tc2(y2)  =  a2  +  b2y2  +  c^,     a2>  b2,  c2  >  0, 

v;here  y.  and  y„  represent  the  volumes  of  output.  The  firm  must  produce 
exactly  s  units  per  time  period  and  desires  to  split  this  production  load 
between  the  two  facilities  so  as  to  minimize  total  product  cost. 

SOLUTION  BY  THE  MAXIMUM  PRINCIPLE: 

Consider  a  general  case  of  N-production  facilities.   Let  each  production 
facility  represent  a  stage,  and  let 

9  =  y  =  volume  of  output  at  n   stage, 

x.  =  volume  of  product  which  remains  unproduced  up  to  n   stage, 

x„  =  total  cost  of  production  up  to  and  including  n   stage  (pro- 
duction  facility)  where  cost  for  n   stage  is 


_  n,_n.    n  ,  ,  n.n  .   n,_n.2 
Tc  (G  )  ■  a  +  b  9  +  c  (9  )  . 


Then  the  process  may  be  described  by  the  following  two  performance  equations: 

n  _  n-1   nn  0  _         N  _  _ 

x1  =  xx   -  9  ;     xL  -  s,     Kj  -  0, 

n  =  1,  2,...,  N,  (1) 

x  =  x2   +  La  +  b  (9  )  +  c   (9  )  J,     x2  ■  0.       (2) 

Comparing  equations  (1)  and  (2)  with  performance  equations,  (10)  and  (11) 
Sec.  2,  of  one-dimensional  processes,  we  find 

TUj"1;  9°)  =  xj_1  -  9",  (3) 

G(xJ_1;  9°)  =  an  ♦  bn(9n)  +  cn(9n)2.  (4) 
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Taking  partial  derivatives  of  equations  (3)  and  (4)  with  respect  to  x^   , 

,n 

9  ,  we  obtain 


3T(x;-L;  Q") 
_  n-1 


^K^1;  9n) 
7? 


_  n-l 
9%. 


=  1,  (5) 


■1,  (6) 


=  0,  (7) 


and 

K(x""1;  Qn) 

1 =  b"  +  2  cn(0n).  (8) 

Substituting  equations  (5)  through  (8)  into  the  recurrence  equation  (22) 
Sec.  2,  we  obtain 

, n  .  „  n„n     .  n+1  ,  „  n+l^n+1 

b  ♦  2  c  9      b    +  2  c   9     ,.  . 

-1  -1  (U' 

or 

,n+l   ,n      n+1    ., 
Qn  m     b -_J>_     +     c_     9n+i 

2cn 

Iterative  use  of  recurrence  equation  (9)  and  equation  (1)  until  condi- 
tions in  equation  (1)  are  satisfied  gives  the  solution  to  this  problem. 

However,  a  solution  without  iterative  procedure  can  be  obtained  as  below. 

N-l 
Let  us  assume  a  value  of  x.   =  K  such  that  the  corresponding  value  of 

x.  obtained  by  iterative  applications  of  equations  (9)  and  (1)  is  equal  to 

given  value  of  x.  =  s.   From  equation  (1) 


28 

N-1  _ 
Xl    " 

e  =  k, 

(x  ■  0,  given). 

(10) 

From  equations  (9)  and 

(10) 

eN-L  = 

2  c"-1 

cN           N 
c 

(11) 

Again 

9N"2  - 

,  N-1   ,N-2 

b    -  b 

2cN"2 

N-2 

c 

(12) 

Substituting  equation  1 

[ID  into  equation  (12),  we  obtain 

eN"2  = 

b^1  -  bN"2 
2cN"2 

UN   .N-1       N 

+  b   "  b     ♦   C    K 
„   N-2        N-2 
2  c         c 

or  simplifying, 

9N"2  - 

bN  -  bN'2 
2cN"2 

N 

C    K 
N-2  K* 
c 

(13) 

Again  from  equations  (9)  and  (13) 

9N"3  - 

,  N-2   .  N-3 

b    -  b 

2cN"3 

N-2 

♦  c      9N"2 

N-3 
c 

• 

,  N-2   .  N-3 
b    -  b 

2cN"3 

VN   ,_N-2       N 
+  b  -  b         c 

,  N-3       N-3 
2  c         c 

= 

bN  -  bN"3 
2cN"3 

N 

C     K 

N-3   * 
c 

(14) 

From  equations  (11),  (13)  and  (14),  we  can  generalize  for  decision  at 

th 
n 

stage  in  terms  of  decision  at  N   stage  K, 
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,  N    n      N  M 

en  =  b  -  b  +  S_  K     (where  G=  K),  (15) 

„  n        n    / 
2  c       c 


and 


1        V.N     K1         N 

91  =  b  "  b   ♦  £r  K.  (16) 

2  c        c 

Once  the  decision  variables  for  all  stages  have  been  obtained,  we  calculate 
Xj  iteratively  as  follows.   From  equations  (1)  and  (10),  we  obtain 

N-2  _  N-l  .  _N-1 
Xl   "  Xl   +  9 

N    N-l       N 

=  K  +  B — Z-± +  _£ —  K  (17) 

N-l        N-l 
2  c         c 

From  equations   (1),    (13)   and    (17),   we  get 

N-3  _      N-2    .    „N-2 
Xl       "  Xl        +  8 

UN        .N-l             N                 UN        vN-2  N 

=   K  +  >  ,  -,  b _c_  b     -  b .      _c_ 

K  .      N-l  N-l      *  „     N-2  N-2   * 

2  c  c  2  c  c 

N  N  UN  .N-l        ,  N  ,  N-2 

=  ["  * -fe  *  ♦ -fe  d  +  ^t^"  +  TfcrL      (18) 

c  c  2c  2c 

Combining  equations  (1),  (14)  and  (18),  we  obtain 

N-4  N-3    .    rtN-3 

Xl        =  Xl        +  G 


N  N  .  N  .  N-l        ,  N  ,  N-2 

[k  +  -9~  k  +  -S~  k]  ♦  r5-^ —  + b-^ — ] 

L  N-l  N-2      J        L    .    N-l  .  N-2   J 

c  c  2c  2c 


.N       uN-3  N 

+  b_^_i> +     _c_     K 

_      N-3  N-3 

2  c  c 
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=  [K 


N        N 


K  +  -5-T  K  + 


N-l      N-2 
c       c 


N 
N-3  KJ 


,N   .N-l   ,N   .N-2   .N   .N-3 

L  „  N-l      _   N-2      _   N-3   J' 
2  c         2  c         2  c 


or 


N-4   „  N 
x.   -  K  c 


2   A- 

[n=N-3  cn  . 


N-l   ,  N   ,n 
♦     2   (b  "  b  ) 
n=N-3   2  cD 


(19) 


In  general,  we  obtain 


x    ■  K  c 


N   1 
2   f; 

i-n+1  c 


N-l   ,N   ,i 
2   (b  -  »  ) 

i=n+l   2  c 


(20) 


and  in  particular  for  n=0,  we  obtain 


0   .  „  N 
Xl   =KC 


N  ,  N-l  UN   .n 

2  i-  +    2  (b  '  b  ) 

n  ,    „  n 

n=l  c  J  n=l    2  c 


(21) 


As  x.  ■  s,  we  obtain 


K  c 


N  1 
(  2  *-) 

-i   n 
n-l  c 


N-l  ,N   ,n 
+   2  (b  -_b  )  =  s, 


n=l   2  c 


n 


or 


K  ■  9  = 


s  -  2  ( ) 

n-l   2  cn 


n=l  c 


N  * 


(22) 


Equations  (9)  and  (22)  give  a  complete  sequence  of  decision  variables  0  ; 
n  =  1,  2,...,  N. 
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Let 


N-l  ,  N   un 
^   p   -  b 
s  -  2   

-i     o   n 

n-I   2  c      _  . 

=  A,  (23) 


N  1 
2  — 

-i   n 
n-l  c 

equation  (22)  then  becomes 

9N  =  ^  .  (24) 

c 

Substituting  equation  (24)  into  equation  (11)  yields 

QN-1  =  b   -  b +  _A_  (25) 

8       .  N-l        N-l  *  U5) 

2  c         c 

Substituting  equation  (24)  into  equation  (13)  yields 

„  0   .  N    N-2       . 

6       _   N-2        N-2  *  (26) 

2  c         c 

Similarly  substituting  equation  (24)  into  equation  (14)  gives 

GN-3  =  b   -  b +  _A_ 

6       ,   N-3        N-3  '  (27) 

2  c         c 

From  equations  (24)  through  (27),  by  comparison,  it  may  be  concluded 

that 

bN   bn     A 

e°  =  T~  +  ~  '        n  =  1,  2 N,  (28) 

2  c        c 

where  A  is  given  by  equation  (23).   For  the  given  problem  N  a  2,  from  equation 
(23),  then,  we  obtain 
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K2     U1         1   2 

A  =  C.  -  (b  -»  )]  -P-T  .  (29) 

2  c      c  +  c 


From  equations  (28)  and  (29),  we  obtain  for  n  =  1: 


2          1                        2          1               12 
Gi  a  *     -  b1  +  [s  _  (bZ  -  bX)j       cV .     1 


or 


for  n  =   2 


1  L  ,     1  ,   1    .      2,  1    ' 

2c  2c  (c     +  c    )  c 


2  ,,2        ,1.                        2 

el  =  £ (b  .  ,-,  b  „)   r      _  c 1 

9             1   +      2   S  .      1          L1          1    ,      2J 

c+c  2c                       c+c 

2  2          1 

c               .       (b      -  b    )  ,,,-v 

"  "^7^ s  77T1  2,  '                            (30) 

c+c  2   (c+c) 


,2        vl  12 

2       A_  _    P  b      -  b    i  c   c  .    1 

2        LS   "     „      1      J      ,    1    .      2N  2 

c  2c  (c+c)c 

1                             u2         u1 
-   -  c                           b      -   b  ... , 

s   -  : —  .  (31) 


1  2  1  2      ' 

c+c  2   (c     +  c    ) 


SOLUTION  BY  THE  LAGRANGE  MULTIPLIER  METHOD: 
The  function  to  be  minimized  is 


-.12,.       1    .    ,  1    1  1.    1,2    ,      2    .    .  2   2    .      2,    2,2 

f(y  y    )-a     +by     +c(y)     +a     +by     +c(y), 


and   the  constraint   is 


1  +     2  = 
y     +  y    "  s. 


The  Lagrangian  function  for  this  problem  is 
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Uy\y2,  A)  ■  a1  + 

by  ♦  cV)2  ♦  a2  ♦  b2y2  ♦  c2(y2)2 

+ 

)\(s-yl-y2).                                                     (32) 

12      *\ 

Taking  partial  derivatives  with  respect  to  y  ,  y  ,  and  /\  yields 

3L 

1 

2>y 

=  bL  + 

2  cV  -*  -  0,                        (33) 

2>L 
2 

ay 

=  b2  + 

2  c2y2  -  *  -  0,                        (34) 

and 

dL 

=  s  -  y 

-1  -  y2  =  0.                             (35) 

Assuming  that 

these  derivatives  will  equal  zero  for  some  positive  y  and 

y  ,  from  equations 

(33)  and 

(34),  by  subtraction,  we  obtain 

1 

y  - 

b2-bL 
2  c1 

*    i  y  • 

c 

since 

2 

y  ■ 

1 
s  -  y  , 

1 

y  = 

2 
c 

h2   h1 

1  4-    2 

c  +  c 

s  +  --■       .   ,                         <-iv ) 
2  (c  +  c  ) 

and 

2 

y  - 

1 

c 

K2   h1 

1  *    2 

c  +  c 

s  -            .                        137 J 

2  (c  +  c  ) 

Because  of  the 

:  great  complexity  involved  it  is  very  difficult  to  find  a 

general  relation  for  N-production  facilities  by  Lagrange  multiplier  method. 
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The  results  obtained  above  may  be  applied  to  problems  such  as  the  one 
dealt  below. 

EXAMPLE  (2a).        A  CONSTRUCTION  COMPANY'S  PROBLEM 
PROBLEM  [Ref.  1,  p.  104]: 

A  construction  company  is  building  a  large  dam  in  a  desert.  There  are 
two  roads  which  provide  access  to  the  dam  site,  both  roads  originating  at  a 
town  where  the  construction  company  owns  a  cement  plant  which  is  to  provide 
all  the  cement  for  the  dam.  The  construction  company  ships  ready  mixed 
concrete  in  its  own  trucks  from  the  plant  to  the  dam  site.   In  fact,  it  is 
the  only  user  of  the  two  roads.   It  knows  that  the  more  concrete  it  ships 
along  any  road,  the  higher  the  shipping  cost  will  be,  because  of  increasing 
congestion  which  causes  bunching  of  traffic,  etc.  A  careful  study  of  costs 

uncovers  the  following:   (1)  the  total  cost  of  shipping  x  cubic  yards  per  day 

2 
along  road  1  is  c.(x)  =  ax  +  bx  where  a,  b  >  0;   (2)  the  total  cost  of  ship- 

2 
ping  y  cubic  yards  per  day  along  road  2  is  c_(y)  =  cy  +  dy  where  c,  d  >0. 

Each  day  exactly  K  cubic  yards  must  be  shipped  from  plant  to  dam.   Determine 

x  and  y  for  most  economical  shipping  of  concrete. 

SOLUTION  BY  THE  MAXIMUM  PRINCIPLE: 

To  make  it  a  general  case  let  there  be  N  roads  providing  access  to  the 
dam.   In  order  to  apply  the  maximum  principle,  let  each  road  represent  a 
stage.   Considering  the  n   road,  let 

0  =  cubic  yards  of  concrete  shipped  per  day  along  the  n   road, 

x.  ■  cubic  yards  of  concrete  which  remain  to  be  shipped  after  the 
first  n  stages, 

x_  =  total  cost  of  shipping  up  to  and  including  the  n   stage  where  the 


35 


cost  of  shipping  at  n   stage  is 

„,n,„n.  _  ,n  n  ,   n.  n.  2      .  n   n  >. 
T  (0  )  =  b  0  +  c  (0  )  ,     b  ,  c  /  0 

Then  the  system  may  be  described  by  the  following  performance  equations, 

xj  =  x^1  -  Gn,     xj  =  K,     X*  =  0,  (38) 

n  =  1,  2,.. . ,  N. 

x£  =  x^1  +  bV  ♦  cn(0n)2,     x°  =  0,  (39) 

n  =  1,  2 N. 

From  equations  (38)  and  (39),  we  obtain 

T  tej-1;  0n)  =  xj"1  -  9n,  (40) 

G  (xj-1;  0n)  =  bV  +  cn(0n)2.  (41) 

Partial  differentiation  of  equations  (40)  and  (41)  with  respect  to  x    and 
9  gives 

-„   ,    n-1      „n. 
3T  (x        ;   3   ) 

—1 =      l-  (42) 

3T   ttf"l|   G") 

^ -     -I.  (43) 

3  0 

„«    /    n-1      „n. 
3G   (x        ;    0   ) 

~I =     o>  «*> 

3x1 

and 


36 


JG  («?-1;  0n) 

1 =  bn  +  2  cV.  (45) 

3  0" 

Substituting  equations  (42)  through  (45)  into  the  recursive  equation  (22) 
Sec.  2,  we  obtain 

un  -u  -,   nnn        un+l  a.  o   n+l.n+1 

b  +  2  c  8      b    +  2  c   9     M  . 
-1  -1  lWi 

or 

,n+l   ,  n      n+1    ., 
en  =  b -__b_     +  c Qn+1  6 

2  cn 

As  equations  (42)  through  (46)  are  the  same  as  equations  (5)  through  (9),  we 
can  use  the  results  obtained  before.   From  equation  (23),  we  obtain 


N-l  ,N   un 

K  -  2  (b  ~nb  ) 

A-   "^   2  C"     .  (47) 

2  i- 

i  n 

n-l  c 


For  the  given  problem  N=2,  i.e.,  two  roads,  from  equation  (30),  we  obtain 

_  ftl  _   c  b  -  b 

x  -  0  =  — : s  + 


1,2"   _  .  1  .   2  » 
c  +  c      2  (c  +  c  ) 


or  in  terms  of  constants  given  for  this  problem, 


rh   K  +  2  (bVd)  '  (48) 


And  equation  (31)  yields 


y   "  ^   =  b^  K  -  2  ^bVd)  (49) 
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EXAMPLE  (3).  CONSULTING  ENGINEER'S  PROBLEM 

PROBLEM  [Ref.  1,  p.  20]: 

A  consulting  engineer  whose  services  are  in  great  demand  charges  w 
dollars  per  day  and  has  decided  to  limit  his  work  schedule  to  B  days  per 
year.   He  works  in  both  Canada  (C.)  and  the  United  States  (C-)  and  pays  taxes 
in  each  country  on  the  income  earned  in  that  country  only.  The  tax  schedule 
for  each  country  can  be  adequately  approximated  by  functions  T  (y.)  and 
T  (y  ),  which  are  defined  as  follows  (letting  y.  represent  total  income 
earned  in  country  C): 

W  =  Pi  yi  +  *i  y\  » 

T2  (y2>  =  p2  y2  +  q2  y2  . 

The  problem,  of  course,  is:   How  should  the  engineer  split  his  time  between 
the  two  countries  so  as  to  make  the  greatest  after-tax  income. 

SOLUTION  BY  THE  MAXIMUM  PRINCIPLE: 

To  make  the  above  problem  a  general  case,  an  N-country  decision  situa- 
tion is  considered  below. 

In  order  to  apply  the  maximum  principle  let  each  country  represent  a 
stage. 

Let 

9  =  number  of  days  the  engineer  works  in  the  n   country, 

x.  =  number  oz   days  remaining  after  having  worked  in  the  first  n 

countries, 
x„  =  after-tax  income  up  to  and  including  the  n   country. 
Further,  to  make  the  problem  more  general,  let  w  be  the  engineer's  charge 
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in  dollars  per  day  in  n   country.  Then  the  total  earnings  in  the  n 

country  are 

n  _   _n  n 
y   =  G  w  . 

(1) 

-i-   th 
lax  expenses  in  the  n   country  are 

_n.n.    n  n,   n.n.2 
T  (y  )  =  p  y  +  q   (y  ) 

(2) 

Substituting  equation  (1)  into  (2)  yields 

_n.n.    n  n  _n  ,   n,n.2._n.2 
T  (y  )  =  p  w  9  +  q  (w  )   (0  )  . 

(3) 

tli 

After-tax  income  in  the  n   country  is  then 

„    ,„n   n-1.    n   mn  ,  n. 
G  (0  ;  x   )  =  y   -  T  (y  ) 

„n  n    n  n  „n    n  ,  n,2  ,.n.2 
=  0  w  -p  w  0  -q   (w)   (0) 

_..   n.   nn    n  ,  n  2   n  2 
=  (1-p  )  w  0  -  q   (w  )   (0  ) 

_  n  n  _n    n  .  n  2  ,Qn  2 
■  a  w  0  -  q  (w  )   (0  )  , 

(4) 

where 

n  -  -i    n 

a  =  1  -  p 

The  performance  equations  are 

n  _  n-1    n       0  _  _       N  _  _ 
xx  -  *1        -  0  ;     xl   -  B,     xl   ■  0, 

n-1,  2,...,  N, 

(5) 

n  _  n-1  .  r  n  n  _n    n  .  n.2  ,„n,2i       0 
X2    2   +  La  w  0   -  q  (w  )   (0  )  J,     x  =  0, 

n  =  1,  2, . . . ,  N. 

(6) 
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Objective  function: 

N 
max.  x  , 

Constraints: 

0  ^  Gn  ^  B. 

(7) 

In  equation  (6),  a",  w"  and  q",  n  =  1,  2,...,  N  are  given  constants. 

Let 

n  n   ,  n 
a  w  =  b  , 

n  ,  n.2    n 
q   (w  )  =  c  . 

(8) 

Then  equation  (6)  becomes 

n    n-1  .  r,n  n    n  ,.n  2-i       0  _ 
x2  =  x2   +  Lb  G   -  c   (G  )  J,     x2  ■  0, 

(9) 

n  =  1,  2, ...,  N. 

From  equations  (5)  and  (9) 

T  (xj"1;  Gn)  =  x""1  -  Gn, 

uo, 

G  (xn_1;  Gn)  =  bn  Gn-  cn  (Gn)2. 

(11) 

Differentiating  equations  (10)  and  (11)  partially  with  respect  to  x 

and 

9  yields 

-.  ™   ,   n-1   _n. 
3T  (x   ;  G  ) 

—     1 

(12) 

3^ 
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and 


L_- =  o,  (13) 

^  n~i 


DT  Cx""1;  en) 

1 =   -i,  (14) 

2en 


l- =  bn-2c"  ©n.  (15) 

30° 


Substituting  equations  (12)  through  (15)  into  the  recursive  equation  (22) 
Sec.  2  yields 

bn  -  2  cn  9n  =  bn+1  -  2  cn+l  en+1, 

or 

n+1        ,n+l    n 

en  =  ^—  on+1  -  * =-*-  .  (16) 

2  c" 

As  equations  (12)  through  (15)  are  the  same  as  equations  (5)  through 
(9)  of  example  (2),  except  that  c  in  example  (2)  is  now  replaced  by  -c  , 
we  obtain  the  solution  by  making  use  of  results  obtained  in  example  (2). 

From  equation  (23)  of  example  (2),  replacing  c  by  -c  ,  we  obtain 


N-l  .  N   . n 

B  +  2  b  ~  b 
n 
a  -      n=l   2  c  . 

A  -  - .  (17) 

N 

2  *- 

-i   n 
n-l  c 

The  general  solution  given  by  equation  (28)  of  example  (2)  then  reduces  to 
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g  =  b   -  b   _  A_ 

-2  c      c 


n  =  1,  2, .. .,  N, 


(18) 


where 


,  n      n  n 
b   =  a  w  , 


n      n  .  n.2 
c   =  q  (w  )  , 


(19a) 
(19b) 


and 


n     ,    n 
a   =  1  -  p  , 


n  =  1,  2,...,  N. 


(19c) 


For  the  given  problem  N  ■  2,  and 


1  _   2  _   0 
w   -   w   -  w  , 


(20) 


substituting  equations  (19)  and  (20)  into  equations  (17)  and  (18)  yields 


B  + 


i     1  2 


A  - 


J_SL 


q   q 


(21) 


G 


n    2 
n  _  p   -  p    A 

.  0  n  On 

-2w  q  w  q 


n  ■  1,  2, 


Substituting  equation  (21)  into  equation  (22),  we  obtain 


(22) 


91  =  -^~ r  B 


1  2 

_2 -  P 


q+q  2w(q+q) 


(23) 


and 


•>  1  12 

e2  =        q        B  + p     -  P 


1.      2  "  '  0  ,   1   .      2     * 

q+q  2w(q+q) 


(24) 
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2 
0  and  8  given  by  equations  (23)  and  (24)  are  the  optimum  number  of  days  the 

consulting  engineer  must  work  in  Canada  and  the  United  States  respectively  in 

,jt     1  -  1  -  „ 

order  to  make  the  greatest  after-tax  income.   For  instance  it  p  -  q  -  0 

2       1 
(i.e.  no  tax  in  Canada),  then  equation  (24)  gives  G  =  0,  (G  >  0),  i.e.,  the 

engineer  should  not  work  in  the  United  States,  which  is  quite  obvious. 

EXAMPLE  (4).         AN  ADVERTISING  INVESTMENT  SCHEME 
PROBLEM  [Ref.  1,  p.  372]: 

You  are  the  sales  manager  for  a  firm  which  sells  two  products.   You  have 
been  alloted  B  dollars  with  which  to  promote  two  products.   Some  market 
research  has  shown  that  the  most  likely  total  sales  (in  units  of  products) 
over  the  next  year  as  a  function  of  the  quantity  of  funds  spent  in  promotion 
will  be 

2 
sL  (xL)  =  al   +  b1   (xL)  , 

2 
s2  (x2)  =  a2  +  b2  (X2')  ' 

where  s.  is  the  number  of  units  of  product  and  x.  is  the  amount  spent  in 
promotion  and  a.  and  b  are  positive  constants.  Product  1  yields  a  constant 
gross  profit  per  unit  of  w.  dollars  and  product  2,  a  gross  profit  per  unit 
of  w_  dollars.  How  should  you  invest  to  maximize  the  gross  profit? 

SOLUTION  BY  THE  DISCRETE  MAXIMUM  PRINCIPLE: 

To  generalize  the  problem,  we  consider  that  B  dollars  are  to  be  alloted 
to  N-products.   To  apply  the  maximum  principle  let  each  product  represent  a 
stage  and  considering  the  n   stage  let 

G  =  x  =  amount  spent  in  promoting  the  n   product  yielding  correspond- 
ing sales 


■. 

s  (0  )  =  a  +  b  (8  )  , 

x.  =  amount  that  has  not  been  invested  in  the  first  n  products j 

• 

x2  =  total  profit  up  to  and  including  the  first  n  stages  where 

gross 

th       .   n.^n.  n   r  n  ,  ,n.„n.2T  n 
profit  for  the  n   stage  is  s  (8  )w  =  La  +  b  (8  )  J  w  . 

The  performance  equations  are  then  given  by, 

n    n-1   .n       0  _  _       N  _ 
xl   =  JC.    -  6  ,     xl   ■  B,     JKj  -  0, 

«u 

n  =  1,  2,...,  N, 

n  _  n-1  .   n  n    n  n..n  2      0   n 
x  =  x    +  a  w  +  b  w  (8  )  ,     x  =  0, 

(2) 

n  =  1,  2, .. .,  N. 

Constraints: 

0^  6n<  B,          n  =  1,  2,...,  N. 

Objective  function: 

Max.  2  [aV  ♦  bV(8n)2] 

n=l 

=  x!J,        C]L  f   0  (xj  =  0), 

(3) 

c2  =  1. 

The  adjoint  vector  z  and  the  Hamiltonian  are  given  by 

„n    n  n  .   n  n 

a  =  zx  x:  +  z2  x2 

=  z\   (xj-1  -  8n)  ♦  z\   [x^1  +  aV  +  b'wV)2], 

. 
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n-1    3Hn      n 
zl   -  ~^    ~     Zl  • 

ax. 


n-l  _  9Hn       n       N 

Z2   ~   n-l     Z2'     Z2   ~2 
Bx2 


(5) 


«"  ■  C  -  1.  (6) 


From  equation  (6),  we  obtain 

z£  =  1,        n-l,  2,...,  N.  (7) 

Substituting  equation  (7)  into  (4),  H  becomes 

rJ1     -       n  ,  n-l   .n.  .  n  n  ,  ,  n  n..n  2  /0, 

H   =  z  (x,   -  0  )  +  a  w  +  b  w  (0  )  .  (8) 

As  z  ,  x.   ,  a  and  w  for  a  given  problem  are  constant,  the  variable  part 
of  Hamiltonian  becomes 

„n     ,  n  n..n.2    n  _n  .,.. 

H   =  b  w  (G  )  -  z.  ©  .  (9) 

v  1 

It  should  be  noted  that  as  the  performance  equations  are  linear  in  state 
variables  x.   ,  namely  of  the  form  [see  equation  (8)  of  Sec.  2J, 

Tn  (xn_1;  0n)  =  2  An.(9n)xn_1  +  fn(0n), 
i-1  J1     J 

a  local  maximum  (or  minimum)  of  the  objective  function  corresponds  to  a 
local  maximum  (or  minimum)  of  the  Hamiltonian  function.   In  other  words 

H   -  maximum  (or  mmxmum) 

is  the  necessary  condition  for  the  objective  function  to  be  locally  maximum 
(or  minimum).   Further,  when  A.,  is  constant  (as  is  in  this  case),  or  when 
the  optimal  decision  is  always  known  to  be  on  the  boundary  of  its  admissible 
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region,  the  objective  function  is  absolutely  maximum  (or  minimum)  if  and  only 
if  H°  is  absolutely  maximum  (or  minimum).  Furthermore  there  is  a  direct  cor- 
respondence between  H  and  S  and  their  respective  derivatives,  i.e., 


and 


r,n  .       „n 

max.  H  ;s  max.  b  , 


3H 


as 


3en   aen 


32H"   ^   32S" 
3(Gn)2  ""  3(0n)2  * 


From  equation  (9),  we  obtain 


n11  -  vn  n/r-,ni2    n  ,_n 
H  =  b  w  (9  )   -  z  0  . 


(10) 


Differentiating  with  respect  to  8  for  maximum  H  gives 


2£-  2bnwV  -«?«  0, 


(11) 


•=,2r,n 

-  2  b  W   >  0, 


a(Gn)2 


(12) 


since  b  and  w  are  both  positive.   Hence  equation  (11)  yields  a  value  of 
0  which  gives  a     minimum,  and  the  maximum  value  of  H  lies  at  the  boundaries 
o^  0  . 
Stage  1: 

From  equation  (10),  we  obtain 


„1  _  .1  l,„lv2    1.1 
H  -  b  w  (0  )   -  z  ©  , 


(13) 
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and  the  stationary  points  can 

be  found  from 

3H1  „  _  .  „   .1  1.1    1 
— r  =  0  =  2  b  w  0  ~  zi  • 

39 

(14) 

The  stationary  points  are  located  at 

0=0   when 

z£  =  0, 

(15) 

9  =  B   when 

zj  =  2  bVB, 

(16) 

and 

9  -  —   when 

z  -  b  w  B. 

(17) 

The  three  conditions  are  illustrated  in  the  plot  of  H  versus  9 

in  Fig.  4. 

Therefore,  H  ■  maximum  at 

'   V 

9=0   when 

z  >  b  w  B, 

(18) 

9  =  B   when 

z.^;  b  w  B. 

For  Stage  2: 

2 

Similarly  for  stage  2,  we  obtain  H  =  maximum  at 

9=0   when 

2    2  2 
z£  >  b  w  B, 

(19) 

9  =  B   when 

z1  ■$  b  w  B, 

(20) 

and  in  general  then  H  =  maximum  at 

9=0   when 

n  ^ , n  n_ 
z^  ^  b  w  B, 

(21) 

0  =  B   when 

n  .,  .  n  n 
z^  ^   b  w  B, 

(22) 

n  =  1 

2      N 
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Hi 


Z1  =2b,wlB 


B 


0' 


Fig.  4.     Hi  versus  01  for  various    values 
of    Zl. 
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Furthermore  from  equation  (5),  we  obtain 

n~l     n             _  <■>   o        M 

z.    -  z1 ,        n  -  2,  J,...,  JN. 

(23) 

Assuming  that 

.1  1  w  u2  2  .  u3  3       ,,NN 
bw  >bw  >bw  >  . . .  >  b  w  , 

(24) 

then  from  equations  (21)  and  (22)  we  see  that 

if            z^<bnwnB, 

on=  on-1  =  ...  =  01  ■  B, 

en+1  =  en+2=  ...  =  eN=o. 

However, 

e1  +  e2  +  e3  +  ...  +  eN  =  b. 

Hence,  if  w  b  B  <  z.  ^  w  b  B,  we  obtain 

91  =  B, 

• 

and 

2    3         N 

9  =  9  =  ...  =  0  =  0. 

Ln  general,  if 

k,  k  ^   n,  n 
WD  >  w  b  , 

n  =  1,  2,...,  N, 

nn. 

chen  the  optical  solution  is  given  by 
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ek  =  b, 


Gn  =  0,        n  =  1,  2,...,  N, 


n  ?  k. 
For  the  given  two  product  problem  then 


and 


91  =   B       if       wV  >  w2b2, 


6=0       if       wb<wb, 


e2  =  b  -  e1. 


EXAMPLE  (5).        A  PROBLEM  IN  PRODUCTION  SMOOTHING; 

A  PERISHABLE  COMMODITY 

PROBLEM  [Ref.  9,  p.  282;  Ref.  1,  p.  37l] 

The  manufacturing  process  for  a  perishable  commodity  is  such  that  the 

cost  of  changing  the  level  of  production  from  one  month  to  the  next  is  twice 

the  square  of  difference  in  production  levels.  Any  production  not  sold  by 

the  end  of  the  month  is  wasted  at  a  cost  of  $20  per  unit.  Given  the  sales 

forecast  below,  which  must  be  met,  determine  the  optimal  production  schedule. 

Assume  the  December  production  was  <<  . 

Month:  January   February   March    April 
Sales:    210       220       195      180 


SOLUTION  BY  THE  MAXIMUM  PRINCIPLE: 

Let  each  month  represent  a  stage  and  considering  the  n   stage  let  us 


define 


Xj  =  production  during  the  n   month, 
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n                                  <-  ,      i     •  \  th   j  th 
8   =  the  difference  in  production  levels  of  the  (n-1)   and  n 

month, 

s   =  sales  forecast  for  the  n   month, 

x"  =  total  cost  of  production  up  to  and  including  the  n   month 

where  the  cost  of  the  n   month  is 

Gn  =  2C8n)2  +  20(xJ  -  s"),   if   (x")Calc  >  sn, 

■ 

=  2(Gn)2,    if   (xj)calc><  sn. 

Hence  three  cases  arising  are 

(1)   'Vcalc?  S  ' 

(ii)   ^Clc*  *"> 

(iii)   (x. )„  ,  >  s  ,   for  some  n's, 
1  Calc' 

(x,  )_  ,  xC  s  ,  for  other  n's. 
1  Calc.*- 

Each 

case  is  dealt  with  as  follows. 

Case 

(1):       'Vcalc?  S  ' 

The  performance  equations  for  this  case  are 

x  =  x    +  G  ,     x  ■  °C  =  300,                   (1) 

n  =  1,  2, . .. ,  N, 

X°  -  x^1  +  2(8n)2  ♦  20(x^  -  sn) 

=  x^1  +  2(0n)2  ♦  20CXJ-1  +  9n  -  s").               (2) 
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Constraint 

: 

n 
Xl 

n 
>   s  • 

(Demand  must 

be 

met 

for  each  month). 

Objective 

faction: 

Max 

2 
;.  2 
i=l 

C.x 

i 

N=  xN      C 
i   X2'     C 

1  " 

0, 

C2 

=  1. 

(3) 

From  equations  (1) 

and  i 

U), 

we  obtain 

T  ( 

n-1 
Xl   ; 

6n) 

-  x-1  +  en, 

(4) 

G  ( 

n-1 
Xl   ; 

Gn> 

=  2  (Gn)2  + 

20  1 

[X1 

+  9n 

-  s  ). 

(5) 

Partial  di 

.fferenti 

ation 

of 

equations  (4) 

and  (5) 

with 

respect  to 

n- 
Xl 

and 

0  yields 

■£>  T 

,  n-1 
(xl 

;or 

') 

• 

(6) 

n- 

i 

1> 

?G 

(xl 

;er 

') 

(7) 

n- 

l 

20, 

~d  T 

.   n-1 
(X1 

;  er 

l) 

(8) 

36" 

-   i> 

and 

2)G 

t   n-1 
(X1 

;er 

A    Qn  + 

20. 

(9) 

-   H  0   + 

39n 

Substituting  equat 

:ions 

(6) 

through  (9)  into 

the 

recurrence  equation, 

equation 

. 

(22)  in  Sec.  2,  yields 

4  9n  +  20  _  4  Gn+1  +  20 
1           1 

or 

Gn  =  9n+1  -  5. 

(10) 

Since  the  end  point  is  not  fixed,  from  equation  (23)  in  Sec. 

2,  we  obtain 

3  G  (x   ;  G  )             N 

—   n   —   A  n   +  nr\ 

— -     —  u  ■  **•  y  T  /u 

or 

SN  -  -5. 

(11) 

Combining  equations  (10)  and  (11)  yields 

N    4 
6  -  0  -  -5, 

(12) 

G3  =  -10, 

(13) 

G2  =  -15, 

(14) 

and 

G1  =  -20. 

(15) 

(x, )„  ,   is  found  from  the  relation 

1  Calc. 

.  n.        n-1  .  „n 
'Vcalc.  =  Xl   +  9  » 

(16) 

and  if 

,  n.         n       n  _  ,  n. 
(x, ).    >  s  ,     x  =  (x. )   , 
1  Calc. x          11  Calc. 

Table  1  illustrates  this  case. 

• 
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Case  (ii):     (x. )n  .    <  s  . 

1  Gale 

Equation  (2)  in  this  case 

becomes 

n-1  _  n-1   „ 
X2     X2 

(9n)2,     x°  =  0.                   (17) 

Equation  (1)  remains  unchanged, 

that  is 

n    n-1  .  „n 
xx  =  x:   +  9  , 

x°  =  *  =  200.                   (18) 

Hence 

m  ,   n-1  „n. 

T  (x1   ;  0  )  =  s 

;J_1  ♦  0°,                           (19) 

G  ex?"1;  0n)  =  2 

!  (9n)2.                              (20) 

Differentiating  the  above 

two  equations  partially  with  respect  to  x. 

and  9  yields 

?T  (x^1;  9n) 

1,                               (21) 

3X 

3G  (X?"1;  9°) 

0,                               (22) 

3  X. 

3T  (x^1;  9n) 

1,                               (23) 

3  9n 

and 

-3G  (x^-1;  9") 

4  9n.                             (24) 

n 

7>  9° 

Substituting  .^uations  (21)  through  (24)  into  the  recurrence  equation  yields 
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or 


4  en  =  4  9n+1 


9n  =  Gn+\        n  =  1,  2,  3.  (25) 


And  from  equation  (23)  in  Sec.  2,  we  obtain 

_  ,  N-l  rtN. 
•&G  (x   ;  ©  )  „ 

l— =  0  =  4  9N 

3© 

or 

©N  =  0.  (26) 

Combining  equations  (25)  and  (26),  we  obtain 

e"  =  0,        n  =  1 4.  (27) 

Hence  (x, )„  .   =  x  ~  ,  and  since  the  sales  must  be  met,  if  (x. )„  .   <;  s  , 

1  Calc.    1  i  uaic.  ^* 

n    n 
x  =  s  . 

An  example  is  shown  in  Table  2. 

Case  (iii):  Mixed  cases. 

(x, )„  ,  >  s   for  some  n's. 
1  Calc. 

(x.  )_  ,  x;  s   for  other  n's. 
l  calc.^ 

This  case  is  best  solved  by  combining  the  results  obtained  in  cases  (i) 

and  (ii).   First  it  is  assumed  that  (x, )_  ,  >  s  where  (x,  )„  ,  =  x.   +  ©  , 

1  Calc.  1  Calc.   1 

and  6  is  given  by  equations  (12)  through  (15);  then 

.  n.  _  .  n 

(V  -  (xl}Calc. 
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The  two  examples  shown  in  Tables  3  and  4  illustrate  this  case. 

It  is  noted  that  if  the  sequence  of  sales  forecast  is  further  changed 
from  that  above,  the  maximum  principle  and  dynamic  programming  will  not 
necessarily  yield  an  optimum  production  plan  without  further  analysis. 

SOLUTION  BY  DYNAMIC  PROGRAMMING 

Let  f  (p  )  be  the  minimum  achievable  cost  when  last  (previous)  month's 
n  n 

production  was  p  and  there  are  n  months  to  go,  and  let 
n 

s  ■  sales  forecast  for  the  current  month, 

x  ■  production  for  the  current  month, 

x  =  P 
n    n-1 

According  to  Bellman's  principle  of  optimality,  the  optimal  policy  to 
minimize  cost  function  should  minimize  cost  for  the  current  month  and  total 
cost  for  the  rest  of  the  (n-1)  stages  (subsequent  stages  resulting  from  this 
decision). 

Also  demand  must  be  met  at  every  stage,  then  we  obtain  the  functional 
relation, 

f  (P  )  =   ^n   [2(x  -P  )2  +  20(x  -s  )  +  f   ,(B  .)].        (1) 
nn    x  *>.  s      nn        nn     n-1  n-1 
n  r     n 

Considering  April  as  the  first  month  and  January  as  the  fourth, 

W  =  x  >  180  ^(x.-P,)2  ♦  20(x1-180)]  (2) 


. 
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where 

P1  =  production  during  March, 

Xj  =  production  during  April. 

The  necessary  conditions  of  minimizing  f,(P '.)  is 

— * — —  =  0  =  4  (x.  -  P.  )  +  20 
^             1    1 

or 

x*  =  PL  -  5     UL  >  180). 

(3) 

Substituting  equation  (3)  into  equation  (2)  gives 

f*(PL)  =  2  (P  -  5  -  Px)2  +  20  (P  -  5  -  180) 

=  20  P  -  3650. 

(4) 

For  March  (n  =  2)  we  obtain 

f£(P2)  ■  2  (x2  -  P2)2  +  20  (x2  -  195)  +  f*(PL> 

=  2  (x2  -  P2)2  +  20  (x2  -  195)  +  20  x£  -  3650 

since  P..  ■  x_. 

The  necessary  condition  of  minimizing  f.(P  )  is 

3f  (P  ) 

^x     =  0  =  4  (x2  -  P2)  +20+20 

or 

x*  =  P2  -  10     (x2  >195). 

(5) 
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Then  we  obtain 

f*(P2)  =   2(P2   -   10   -  P2)2  +   20(P2   -   10   -   195)   +  20(P2   - 

10) 

-  3650 

■  40 P     -  7750. 

(6) 

For  February   (n  =  3),   f„(P„)   becomes 

f3(P3)  =  2(x3   -  P3)2  +  20(x3  -  220)   +  40P2  -  7750 

(7) 

=   2(x3   -  P3)2  +   20(x3   -   220)    +  40x3   -   7750, 

and 

j              =     4(x.    -   P.)   +  20  +  40  =   0 
<>x3                      3         3 

or 

x*  =   P3  -   15  =  P2            (x3  >  220). 

(8) 

Substituting  equation   (8)   into  equation   (7)   yields 

f*(P3)  =   2(P3   -   15   -  P3)2  +   20(P3   -   15   -  220)    +  40(P3   - 

15) 

-  7750 

=   60P3   -   12,600. 

(9) 

For  January   (n=4),   we  obtain 

£4(P4)  =  2(x4  -  P4)2  +  20(x4  -  210)   +  60x4  -  12600   , 

and 

3f4(V 

3x            =     0  =   4(x4   -  P4)    +  20   +  60  =   0, 

or 
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x*  =  P4  -  20     (x4>  210).                          (10) 

However,  P,  is  the  production  level  in  December  and  equal  to  200(=°O, 

therefore, 

(x,  )   .   ,  „  .  =  200  -  20  =  180. 
h  calculated 

Since  the  demand  is  210,  the  production  level  should  be 

x,  =  210. 
4 

Equations  (3),  (5),  (8)  and  (10)  give  optimal  values  of  x's. 

x3=P3-15 

■  210  -  15  =  195  <  220  =  s3> 

therefore, 

x3  =  220 

x2  =  P2  -  10 

=  220  -  10  =  210  >  195  =  s2, 

or 

x2  =  210, 

xx  -  B1  -  5 

=  210  -  5  =  205  >  180  =  sL 

or 

Kl  =   205. 

Hence  the  optimal  production  plan  is 
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January   February   March    April 
210       220       210      205 
which  is  the  same  as  that  obtained  by  the  maximum  principle. 

4.   CASE  STUDIES  OF  LINEAR  ONE-DIMENSIONAL  PROCESSES 

In  general  the  one-dimensional  multistage  linear  processes  have  the 
following  form  of  performance  equations 

k[=   x^1  +*[Fi(Gn)]  (1) 

x£  =  x^1  +  P  U[   -  x?-1)  ♦  F2(0n),     x°  -  0  (2) 

where  F^O  )  and  F„(0  )  are  two  arbitrary  functions  of  the  decision  variable 
G  ;  c<  and  £3  are  arbitrary  constants.   It  was  shown  in  Sec.  2  that  the  optimal 
policies  for  such  a  class  of  processes  are  to  apply  an  equal  value  of  the 
decision  variable  at  each  stage. 

EXAMPLE  (5a). 

Let  us  consider  the  production  smoothing  problem  of  the  perishable  com- 
modity; which  we  studied  in  example  (5)  and  consider  the  case  of 
(x. )   .  ^    s  .  The  process  described  by  the  performance  equations  are 

.     n    n-1  .  „n      0   „„„  ,„. 

xx  =  xl       +  G  ;     xL  =  200  (3) 

n  -   n-1  -u  ^  /,^2    ^      n^  n      0  _  _  ... 

X2  ~  X2  '         Xl"^  s  »    x2  *  * 

A  comparison  of  equations  (3)  and  (4)  with  equations  (1)  and  (2)  shows  that 

P-o. 


« 

F  (0  )  =  G  , 

and 

F2(Gn)  =  2  (Gn 

>2. 

Hence  the  problem  belongs  to  1 

a  class  of  one-dimensional  linear  processes  and 

the  optimal  policy  is  to  apply  an  equal  value  of  decision  variable  at  each 

stage,  i.e. 

Gn  =  Gn+1, 

n  =  1 N-1.                       (5) 

This  may  be  verified  as  follows.  From  equations  (3)  and  (4),  we  obtain 

T  CxJ"1;  Gn)  - 

x^1  +  Gn,                             (6) 

G  (xj-1;  Gn)  = 

2  (Gn)2,                               (7) 

and  differentiating  equations 

(6)  and  (7)  with  respect  to  x    and  G  gives 

dT   (X?'1;  Gn) 

=   1,                                (8) 

-,  n-1 

ax 

dG   (xj-1;  Gn) 

=  0,                                (9) 

n-1 
2x 

ST  (x^1;  Gn) 

=  1,               .                (10) 

3Gn 

and 

3G  CxJ"1;  Gn) 

=  4  Gn.                             (11) 

39" 
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Substituting  equations  (8)  through  (11)  into  the  recursive  relation  of  one- 
dimensional  processes,  equation  (22)  of  Sec.  2,  we  obtain 

4  en  =  4  en+1 

or 

Gn=Gn+1  '  (12) 

N 
that  is  the  solution  presented  by  equation  (5).   To  find  0  ,  equation  (23) 


of  Sec.  2  gives 


s_  ,  N-l   N. 
3G  (x    ;  0  ) 

l— =40=0 

3  0 


or 


0N   =  0.  (13) 


Combining  equations  (11)  and  (13)  yields, 


0n  =  0,        n-l,  2,...,  N.  (14) 


As  a  further  illustration  of  one-dimensional  linear  multistage  processes, 
two  examples  are  discussed  next,  the  first  is  a  purely  mathematical  problem 
while  the  second  one  is  an  economic  problem. 

EXAMPLE  (6).         AN  OPTIMAL  SUBDIVISION  PROBLEM 
PROBLEM: 

A  positive  quantity  B  is  to  be  divided  into  N  parts  in  such  a  way  that 
the  product  of  the  N  parts  is  to  be  a  maximum.  Obtain  the  optimal  subdivi- 
sion. 
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SOLUTION 

BY  THE  DISCRETE  MAXIMUM  PRINCIPLE 

In  order  to  use  the  maximum  principle,  let 

:  each  part  represent 

a  stage, 

and  ] 

Let  us  define 

9  ■  part  of  quantity  B  alloted  to  n   stage, 

then 

the 

objective  function  is 

N 
Maximize  p  ■  IT    9  , 
n=l 

(1) 

with 

the 

constraints 

os<e\<  b. 

(2) 

Takii 

ng  the  logarithm  on  both  sides  of  equation 

(1) ,  we  obtain 

N 

In  p  -  2  In  0n. 

n=l 

(3) 

Let  i 

js  define  the  state  variables  as 

x"  =  part  of  quantity  B  left  after  allocation  to  first 

;  n  i 

stages, 

x  =  sum  of  the  logarithmic  ©  which 

is  equivalent  to 

product  of 

first  n  parts. 

Then 

the 

performance  equations  for  the  process 

are 

n  _  n-1   „n       0  _  _ 
Xj^  -  xx   -  0  ,     xl  -   B, 

«"-0. 

n-1,  2 N, 

(4) 

and 

x2  =  x2   +  In  G  ,     x2  -  0. 

(5) 

A  simple 

comparison  shows  that  equations  (4)  and  (5)  are  in  the 

forms  of 
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linear  one-dimensional  processes.   Here 

X   =   -1, 

*«o,                                                                        • 

F^O")  =  Gn, 

F2(Gn)  =  In  Qn. 

Hence  the  optimal  policy  is 

Gn  =  Gn+1,        n  =  1,  2,...,  N-1.                   (6) 

This  is  verified  as  follows.   From  equations  (4)  and  (5),  we  obtain 

T  CxJ"1;  Gn)  =  xj"1  -  Gn,                              (7) 

G  (x""1;  Gn)  =  In  Gn.                                 (8) 

Differentiating  equations  (7)  and  (8)  with  respect  to  x"~  and  Gn  yields 

3T  (X?"1;  Gn) 

.  n-1       "   l»                                 (9) 

dT   (xj"1;  Gn) 

n      -  -1.                          (10) 
d  g 

dG   (x^1;  Gn) 

n    n-1       "   °'                                   (11) 

and 

-a  /■>  I     n~l   ^n\ 

dG   (x   ;  G  ) 

=  e"  • 

68 


Substituting  equations  (9)  through  (12)  into  recursive  equation  (22)  Sec.  1 
yields 


^1  . 


-1 


n+1 


or 


Gn  -  9n+\ 


(13) 


which  is  the  same  as  in  equation  (6)  above.  As  the  end  point  is  fixed 

N 


(x^  =  0),  we  cannot  use  the  relation 


_„  ,  N-l   N, 
3G   (x.   ;  9  ) 


=  0; 


however,  from  equations  (4)  and  (13) 

N 

2  9n  =  N  6°  =  B, 
n=l 


or 


9n  =  £ 

9    N  » 


n  =  1,  2, ...,  N, 


(14) 


and  the  corresponding  objective  function 


N  _  ,B,N 
X2  ~  (N}  ' 


SOLUTION  3Y  THE  LAGRANGE  MULTIPLIER  METHOD: 

Another  approach  would  be  to  use  the  method  of  dynamic  programming  or 
the  method  of  Lagrangian  multiplier.  The  second  method  is  discussed  as 
follows. 

Let  B  be  divided  into  N  parts,  x.,  x  , ...,  x  so  that  we  have  to 
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maximize  the  function 

y  =  *r 

X2  * ' "  XN' 

subject  to  the  constraints 

N 

2  x. 
1-1  * 

=  B;     x.  >  0,        i  =  1,  2,...,  N. 

Let 

Y  =  xr 

x.  ...  xM  +  A[b  -  2  x  ], 
2      N          .1 

1 

(15) 

the  maximum  value  of  y 

,  can  be  obtained  from  the  conditions 

22  _ 

ax. 

0,        i  =  1,  2 N, 

(16) 

3Y  _ 

0. 

(17) 

From  equation  (15), 

SY  _ 

N 

TT  x.  -  A  =  0, 
j-1  J 

or 

>  = 

N 
TT  x.  -*-  , 

j-1  J    i 

(18) 

or 

x.  ■ 

i 

y. 

(19) 

and  equation  (17)  gives 
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#-».-**-• 

or 

B  =  2  x..                                     (20) 

i 

Substituting  equation  (19)  into  equation  (20),  we  obtain 

»  =  ^  =  ¥ 

or 

Substituting  the  value  of  >,  from  equation  (21)  into  equation  (19),  we  obtain 

• 

x.  =  |  ,        i  =  1,  2 N,                      (22) 

and 

R  N 

y  ■  <§>  .                           (23) 

The  results  obtained  above  agree  with  those  obtained  by  the  maximum 

principle. 

EXAMPLE  (7).          STATIC  CONSUMER-CHOICE  PROBLEM 

PROBLEM  [Ref.  1,  p.  37l]: 

Consider  the  decision  problem  of  an  individual  who  has  a  fixed  sum  of 

money  Y  available  for  the  purchase  and  consumption  of  N  different  commodities 

(in  the  amounts  x  ,  x.,...,  x  )  over  some  definite  single  planning  period. 

Assume  that  none  of  the  money  is  to  be  saved  and  that  the  consumer  seeks  to 

maximize  his  utility.  Assume  that  his  utility  for  a  purchase  plan  x  £  X  ■ 

.f  (x.,  x  , ...,  x..) :  x.  £  R  and  x.  >,  Qy  may  be  represented  in  terms  of  mapping 
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U:  x  -y  R  which  is  defined  by 


N 


U  -  s^.x-  •••  xm  ~  ~^    *•• 
i=l 

We  assume  that  the  various  commodities  are  available  in  any  amounts  at  the 
known  and  constant  prices  p..,  p„,  p„,...,  p  .   Solve  for  the  optimal  pur- 
chase plan. 

SOLUTION  BY  THE  MAXIMUM  PRINCIPLE: 

In  order  to  formulate  this  problem  into  the  discrete  maximum  principle 
form,  let  each  commodity  represent  a  stage,  and  let  us  define 

0  ■  money  spent  in  purchasing  n   commodity, 
with  the  constraints, 

0  <©"<$:  Y,  (1) 

then  the  objective  function  becomes 

N   n 
Max.   S  =  TT  2-  (2) 

n=l  p 

Taking  the  logarithm  on  both  sides  of  equation  (2),  we  obtain 

N      n 
In  S  =  2  In  —  (3) 

n-1    p 

Let  us  define  the  state  variables  as 

x.  ■  money  left  after  purchasing  first  n  commodities, 

n  en 

x2  ■  sum  of  logarithmic  —  which  is  equivalent  to  product  of  amounts 

Pn 
of  up  to  and  including  n   commodity  where  amount  of  n 


I 

commodity  =  9 

n  * 

P 

The  performance  equations  are 

xl   =  Xj^   -  9  ;     x1   =  Y,     xx  =  0,                (4) 

n  -   n-l  j.  -i   9        0  _  .                         ,CN 
X2    2       "n  '     X2 
P 

and  the  objective  function  is 

Max.   x!J                                            (6) 

Comparing  equations  (4)  and  (5)  with  equations  (12)  and  (13)  of  linear  pro- 

cesses, we  have 

*-    -i, 

?  »   o, 

F1(9n)  =  9n, 

.   F.(9n)  -  In  4  • 
2           n 
P 

Hence  the  optimal  policy  is  to  apply  an  equal  value  of  the  decision 

variable  at  each  stage,  i.e. 

9°  =  9n+1,        n  =  1,  2,...,  N-1.                   (7) 

This  is  verified  as  follows.   From  equations  (4)  and  (5),  we  obtain 

T  («J-lj  9n)  =  X?"1  -  9n,                              (8) 

„  .  n-1  0n.  _  ,   9 

G  (xL   ;  9  )  -  In  —  .                              (9) 

P 

Partial  differentiation  of  these  two  equations  with  respect  to  x"-1  and  9° 
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gives 

ST 

(xL   ; 

on) 

1, 

(10) 

,»  n-1 
3x1 

3T 

,  n-1 
(xx   ; 

en) 

-1, 

(11) 

c>Gn 

2G 

,  n-1 
(xx  ; 

©n) 

0, 

(12) 

o  n_1 

3^ 

and 

3G 

t   n-1 
(xL  ; 

en) 

—  ,     (p  is  constant). 

Gn 

(13) 

3Gn 

.Substitution  of  equations  (10)  through  (13)  into  the  recurrence 

relation  of 

one-dimensional  processes  equation  (22)  Sec.  3  yields 

-1  . 
9n 

-l 

"  Gn+1 

(1) 

or 

Gn  - 

h   •        N  -  n 
Again,  as  x.  -  0, 

we  cannot  make 

use  of  the  relation 

3G 

,  N-1 
(xL   ; 

eN) 

0. 

seN 

However,  from  equations 

[4)  and 

(13) 
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N 

2  Gn  -  NGn  =  Y 

n=l 

or 

en  "  i  •                             (15) 

N 

5.   OPTIMUM  RECURRENCE  EQUATION  FOR  MULTI- 
DIMENSIONAL PROCESSES 

Let  an  N-stage  system  be  described  by  a  set  of  performance  equations 

"  =  Tn  (*n~l     *n_1      xn_1.  on  9n      Gn) 
i    i    1   '   2   ••••>   s   '   1'  w2'*"*' 

i  —  1,  Z, . . . ,    s , 

or  in  vector  form 

xn=  Tn  (x""1;  Gn),                                  (1) 

where  x  is  an  s-dimensional  vector  and  G  is  an  r-dimensional  vector  which 

is  to  be  chosen  at  each  stage  to  maximize  the  objective  function 

S      N 
S  =  2  c.  xW  .                       •               (2) 

The  procedure  for  solving  such  an  optimization  problem  by  the  discrete 

maximum  principle  is  to  introduce  an  s-dimensional  adjoint  vector  z  and 

a  Hamiltonian  function  H  satisfying 

s 
h"  =  2  zn  Tn  <xn"  ;  Gn),        n  =  1,  2 N,       (3) 

i=l  1  X 

or  in  vector  form 

„n  _  .  n.T  n 
H  -  (z  )  x  , 
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and 

n-1  _ 

2. 

X 

_  n-: 

3xi 

L  •     1-  l- 

2,. 

•  • » 

s; 

n-1, 

>  ^»  •  i 

. .,  N. 

(4) 

Substituting 

equation 

(3)  : 

Into  equation 

(4), 

yi 

elds 

n-1  _ 
Zi   ~ 

s 

2  : 

9Tn 
sn  1_ 

i 

i 

■  1, 

2, • •  •  i 

s. 

(5) 

if  en 

is  unconstrained,  then  for  the  obj 

ective 

function  to 

be  a 

maximum 

,  the 

weak  maximum 

principli 

i   for 

staged  systems  requi 

res 

that 

3H!  . 

o, 

k  =  1, 

2,.. 

• » 

r, 

n  =  1, 

—  j  •  • 

,,  N. 

(6) 

< 

Substituting 

equation 

(3)  : 

Lnto  equation 

(6) 

yie 

Ids 

s 

!3 

r,   n 
£  z. 

k 

=  o, 

k  = 

1, 

2,. 

•  • »  *»» 

(7) 

n  = 

1, 

2,. 

..,  N, 

or  in 

vector 

form 

.  n.T 
(z  ) 

3Tn 
39n 

=  o, 

which 

is  a  short  hand 

form 

of  the  matrix 
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.   n       n                n                n. 
1'    Z2'"**'    Zk>"**'    Zs 

•    •    •                               J-                 •    • 

• 

"I 
"5 

1 

11* 

"a 

3T° 

•  •  •                   £-          •  • 

• 

3T2 

35 

»«2 

aeJ 

*< 

• 

=   0.      (8) 

!S 

^ 

•  •  •                  r*          •  • 

• 

•s 

2e" 

• 

36"2 

»•; 

3Gr 

3Tn 
s 

S 

l>Tn 
•  •  •           s       •  • 

• 

31° 
s 

.  as° 

^ 

^GS 
r 

From  equation   (8)   r-simultaneous  equations 

are  obtained 

as 

£o  1 lows 

3T?                3T"                             3T.n 

n         L         n         2.            .     n         k 

z.     +  z„     +   ...   +  z,      

1    aej       2    3Gn                k    <>gJ 

+     .. 

3Tn 
.   +  z°     -*  ■ 

S     **\ 

0 

3t"               2T"                             3t" 
n          1    ,      n          2.                   n          k 

z,      +   z.     +   ...    +  z.      

1     -  ^n          2    -.„n                       k     _^n 

<382                     2                                  2 

+     .. 

3T? 

,      n          k  _ 

'          k     "IT  ~ 
3G2 

0 

(9) 

•                                                                •                                                                         • 

• 

• 

•                                                                •                                                                         • 

• 

• 

•                                                                •                                                                         • 

. 

• 

r                   r                               r 

+     .. 

.    +   z°     -J  - 

s    a6n 

r 

0 

n 

If  r  %■  s   -   1,    then  considering  z     — *■ 

1  3G" 
(9)  may  be  written 

.     J    = 

l  >   z, • • • >  r 

as 

constant, equation 
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n      ^           n 
n          2    ,      n 

z       +  z„ 

3T3 

n 

+    2, 

Wk 

+   ...   +  z 

n         s 

n 
— z 

3T" 

2     3G?          3 

>•; 

k 

»•; 

S     30? 

1 

38° 

3T? 
n          2    ,      n 

zo      — ^         27 

2    SG^          3 

... 

j.     n 
+  Zk 

+   ...   +   z 

3Tn 
n          s 

n 
-"Zl 

21 

« 

• 

• 

• 

• 

(10) 

• 

• 

• 

• 

• 

• 

« 

• 

• 

• 

3T" 

3T* 

*?!! 

3Tn 

0t" 

n          2  ^      n 

3 

n 

k 

a          s 

_     n 

z       +   z„ 

+   z, 

+...+: 



— z, 

■ 

2     50"           3 

-»„n 

k 

30n 

s    3©n 

1 

36^ 

r 

r 

r 

r 

r 

From  equation   (10] 

1,   we  obtaii 

i 

3T„ 

3T? 

V7n 

3Tn 

2 

3     .. 

• 

n 

1     . 

•   •                      S 



z. 

3oJ 

z*l 

3G1 

3G1 

st" 

ST* 

3T? 

3Tn 

2 

3     .. 

n 

l     . 

•  •          s 



■■  -     ■ 

— 

2, 

n 

n 

1 

n 

~  «n 

3G2 

3G2 

3G2 

^G2 

• 

* 

• 

. 

• 

• 

• 

• 

• 

• 

. 

• 

n 

3T„ 

3Tn 

3T< 

3Tn 

2 

•  • 

n 

1       . 

•   • 

z. 

aen 

30° 

1     , 
3 

6° 

3G 

n 

y 

r 

r 

r 

(11) 

z,    -  ■ 

k 

3T2 
••I 

3t" 

-3 
3T? 

•  •  • 

•  •  • 

3Tn 
s 

~«n 

2 

3 

. . . 

k 

•  •  • 

s 

*<£ 

-«n 

3G^ 

3  9" 

3G" 

2 

2 

2 

2 

# 

. 

# 

• 

• 

• 

3T" 

3T" 

31? 

9Tn 

2 

3 

3 

s 

30° 

3  0° 

3  0° 

30n 

r 

r 

r 

r 

or  equation  (11)  reduces  to 
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n 

z.  - 

k 


K 

3T" 

O           m 

3T? 

BTn 
..     s 

,9J 

< 

*e" 

*91 

• 

. 

• 

• 

• 

• 

• 

• 

. 

• 

• 

• 

Mj 

3  • 

3T" 

•       •                      _.T_|.*7 

s 

-s«n 

r 

-.  ~n 
36 

r 

3© 

r 

3© 
r 

(12) 


where  B  is  the  determinant  of  denominator  in  equation  (11), 


or 


n  _    n  .n 
\  ~   '   Zl  \ 


(13) 


where  R?  is  the  ratio  of  determinants  in  equation  (12),  and  K^   = 
From  equation  (5),  we  obtain 


=  -1. 


s  3T" 
n-1  -  v   n    i 

\   -  ,f,  zi  r^r  * 

1=  1  3  x, 


k  —  1,  2, . .  • ,  s, 


(14) 


then  equation  (13)  yields 


n-1  =   _n-l  nn-l 
1 


■k    ---i    K 


(15) 


and 


n        n  Dn 


(16) 


Substituting  equations  (15)  and  (16)  into  equation  (14),  we  obtain 


s   3Tn 
n-1  „n-l  _  n  „     i    _n 

Zl   \   "  Zl  *     .""n^T  v 


i=l  a 


*k 


(17) 
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Equation 

(17)  is 

n_1 
homogeneous  in  z. 

j  n 
and  z. ,  so 

they  may 

be  eliminated 

to  obtain  generalized 

multidimensional  recurrence  equations  as 

follows, 

» 

From  equations  (13)  and  (5)  respectively  we  obtain 

n-1  _ 
z. 

J 

n-1  Dn-1 
"  zl   Rj   ' 

(18) 

and 

n-1  _ 

3Tn 
«   n    i 

(19) 

i=  l    ax. 
J 

Equating  equations  (18)  and  (19)  yields 

n-1 
Zl   " 

s      3Tn 
y   n    i 

1 
J 

(20) 

-   2,   Z.   ""   , 

i=  1     3x, 

Substituting 

the  value  of  z.  from  equatio 

n  (13)  into 

equation 

(20),  we 

obtain 

n-1  _ 
zl   " 

s      3Tn 

n  r   n    l 

1 

J 

(21) 

z.   *>  R.   , 

1  ._,   i  -.  n-1 
1=  1     3  x . 
J 

Substituting 

equation 

(21)  into  equation 

(17)  gives 

s 
n  v 

Rn    i     1 

1  ax""1  Kn~l 
J     J 

„n-l  _  n 
*k     Zl  . 

s  -aTn 

v   .  x 

Rn 

i 

L-l  ^Xk 

or 

K'1  '■ 

1- 

b  ?>Tn 

r.    1     rn    n-1 

s  -ST" 
i 

Rj-0 

(22) 

L      ■-    K.  -K. 

=1  ax""1   x   J 

j 

i,    n-1 

1-1  3Xk 

Equation  (22) 

is  the  < 

aptimum  recurrence  equation  for 

multi -dimensional 

pro- 

cesses.   It  is  called 

the  generalized  Euler  Equation 

s  [3]. 
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For  the  special  case  s  =  2, 

equation  (22)  reduces  to 

rn-l  r^l   rn  ,  3T2 

1    3T?      „    *A 

n-i   _n-l  r   1   _n     2 

TRp  = 

0.  (23) 

*k   \    n-1  Rl  '    n-1 

a  x .      ax. 

J        J 

V  "  Rj   <-   n-1  Rl  '    n- 

Substituting  R  ■  -1  and 

2     zn   3Tn 
1     2 

A   o 
'  5  Say, 

99n 

into  equation  (23),  we  obtain 

n-1  r3T2   A   3T1   n 

\       \    n-1  B  "   n-lJ 
3x.       3x. 
J         J 

+  [   1   -   2   A]  Rn_1  = 
L   n-1   „  n-1  BJ   j 

3xk     3xk 

0 

(24) 

For  k  -   1,  and  j  =  2,  equation  (24)  reduces  to 

"!     2T2   »,r«! 

.   „  n-1  BJ  D 
3x 

(25) 

_  n-1   ,  n-1  B   L   n-] 
3x2    3x2      axL 

where 

r?"1  =  -1, 

and 

3Tn-l 

• 

(26) 

n-2  _  ^6n_1   _  C 
2     ^n-1    D 

^g""1 

Assuming  that  performance  equations  are  of  the  form 
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*J  =  T^  =  T  CxJ*1;  9n) 


x2   T2   x2   +  G  (xL   ;  ©  . 


(27) 


(28) 


partial  differentiation  of  equations  (27)  and  (28)  yields, 


"dt. 


■2»x, 


n-1 


=  0, 


(29) 


2>Tr 


■3X, 


n-1 


(30) 


Substituting  equations  (29)  and  (30)  into  equation  (25),  we  obtain 


a)A._£[!i_ 

;  '   B     D  L  n-1 

3x1     Zx1 


dG       A 


n-1  BJ  » 


(31) 


or 


3T" 

D  _  B  r   1 

C  ~  A  L^  n-1 
3x, 


?>G A-i 

n-1  BJ  * 


■ax 


(32) 


Substituting  values  of  A,  B,  C  and  D  from  equations  (23a)  and  (26)  into 
equation  (32),  we  obtain 


^G 


"39 


n-1 


3T 


<>e 


n-1 


3G 

ax 


3T 

BG        .   3  9 


_    n-1       _,    n-1       _  „n 
3x  ^x  BG 

39 


(33) 


Substituting  n  ■  n+1  into  equation  (33),  yields 
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•a  g 

n 


■ae 


7)T 
n 


SG 


"&G 


3  9 


n+1 


"SO 


n+1 


3  T 
n 

ax, 


3G 
n 

ax, 


(34) 


n  =  1,  2 N-l. 


Equation  (34)  is  the  same  as  the  recurrence  equation  obtained  for  one- 
dimensional  processes  shown  in  Sec.  2. 
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The  objective  of  this  report  is  to  demonstrate  the  applicability  of  the 
discrete  maximum  principle  to  one-dimensional  multistage  non-linear  as  well 
as  linear  processes  frequently  encountered  in  management  and  industry.   Only 
deterministic  cases  are  considered. 

The  basic  algorithm  of  the  discrete  maximum  principle  is  first  stated. 
The  general  form  of  performance  equations  both  for  linear  and  non-linear 
one-dimensional  processes  is  then  given.  The  recurrence  relation  of  the 
optimal  state  and  decision  for  linear  as  well  as  non-linear  processes  are 
presented.  Case  studies,  examples  (1)  through  (5),  are  the  problems  of  non- 
linear processes.  These  include  a  production  scheduling  plan,  an  allocation 
problem,  a  construction  company's  problem,  a  consulting  engineer's  problem, 
an  advertising  investment  scheme  and  a  production  smoothing  problem.   Case 
studies,  examples  (5a)  through  (7),  are  the  problems  of  linear  processes. 
These  include  production  smoothing,  optimal  sub-division  and  static  consumer- 
choice  problems. 

In  each  of  the  examples  considered,  the  discrete  maximum  principle  leads 
to  the  optimality  condition  represented  by  a  recurrence  relation  of  the 
decision  variable.   Such  a  recurrence  relation  is  generally  valid  for  an 
n-stage  system.   For  each  of  the  special  cases  considered,  such  a  general 
solution  is  reduced  immediately  to  a  specific  solution  which  agrees  with 
available  results  obtained  by  means  of  the  Lagrange  multiplier  technique 
and  by  dynamic  programming. 

Although  a  particular  method  may  not  always  be  superior  to  all  others 
it  may  be  superior  to  others  in  solving  a  certain  problem.   In  order  to  find 
the  best  technique  for  solving  a  particular  problem,  it  is  necessary  to  study 
comparatively  all  available  techniques.   Therefore,  some  examples  are  solved 
by  more  than  one  method. 


